|
1. Account management
1.1 Register
If you are a new comer, you need to register an account firstly
to assess the resources of BIT.
Please click the link of "Register" on the home page to register
an account. You should provide genuine personal information
otherwise your registration request may be rejected. It is
strongly recommended to use the email address of your
organization rather than a free email account for registration.
Your registration information will be examined by the service
team of BIT. If you successfully pass the examination, you will
receive a confirmation email. Please activate your account by
clicking the link on the email.
1.2 Password problem
If you forget your password, please click the link of "Reset" on
the home page to get a new password through email.
You can login BIT to modify the randomly generated password.
2. Download biometric databases
BIT mainly has two purposes. One is for biometric database
sharing and the other is for algorithm evaluation. So the
biometric databases on BIT are classified to two parts
accordingly. One part is publicly available for download and the
other part is sequestered for performance evaluation of
biometric algorithms.
Registered users should login the BIT to download publicly
available iris, face, fingerprint, palmprint, multi-spectral
palm and handwriting databases.
Since the files of biometric databases are huge in size, it is
recommended to use the download software which has the function
to resume broken downloads.
Users are suggested to read the description document of each
database before download. If you only need a small dataset, you
can download a subset file of your interested database.
The download speed may be slow when many users are downloading
the biometric databases simultaneously. So please be patient or
try again later.
3. Algorithm evaluation
Users need to complete the following steps to perform algorithm
evaluation:
Login BIT
Submit an algorithm
Users can submit their face, fingerprint
or iris recognition algorithms for third-party performance
evaluation by BIT.
The basic information for each biometric
algorithm such as its name, version, type, modality, description
must be provided during algorithm submission. In addition, users
are required to report the self-tested results (ROC, EER, etc.)
of their algorithms on publicly available databases of BIT. To
reserve the limited computational resources of BIT to test
high-performance biometric algorithms and track state-of-the-art
of biometrics, only qualified biometric algorithms will be
tested by the BIT system. The definition of qualified biometric
algorithms is as follows.
For an iris recognition algorithm, its EER must be less than 3%
on CASIA-IrisV4-Thousand.
For a fingerprint recognition algorithm, its EER must be less
than 5% on CASIA Fingerprint Image Database Version 5.0.
For a face recognition algorithm, its EER must be less than 8%
on CASIA Face Image Database Version 5.0.
For any biometric algorithm, the average processing time for
feature encoding should be less than 2 seconds and the average
processing time for feature matching should be less than 1
second.
A biometric verification algorithm
should include two executables in the form of Win32 console
applications, i.e. enroll.exe and match.exe. Example of the
application functioning, through command-line:
> enroll imagefile templatefile outputfile
> match templatefile1 templatefile2 outputfile
To help users quickly master the
programming protocols of algorithm evaluation, the source codes
of the example files "enroll.c" and "match.c" are provided for
download.
Create a test task
Users need to create a new test task to
start the testing process of BIT by clicking the "New" item on
the "Tests" area of the left menu. Users need select an
algorithm and a database to submit an application of algorithm
evaluation. It takes about one month to finish a testing task
because of millions of biometric comparisons in a test task.
Once the test task has been finished or abnormally interrupted
due to errors of submitted algorithm, the user will be informed
by email.
Users can browse and edit the submitted
test tasks by clicking the "browse" item on the "Tests" area of
the left menu.
Publish results
Users can decide whether to publish the
testing results or not. If you choose to publish the testing
results, the testing report will be publicly available for
download and the performance metrics of your algorithm will be
compared with others. If your algorithm performs well, it may be
included in the Top5 list.
Get the biometrics performance certification by IAPR TC4
The testing report of high-performance
biometric algorithms will be certified by the IAPR TC4.
|
