ActEV'21 Sequestered Data Leaderboard

UF (Unknown Facilities), KF (Known Facilities)

KA (Known Activities), SA (Surprise Activities)


ActEV'21 Sequestered Data Leaderboard (SDL) Evaluation
Updates
  • Sep 21, 2020: ActEV'21 SDL UF with Known Activities opens
  • Sep 21, 2020: ActEV'21 SDL UF is a competition under WACV'21 HADCV workshop
  • Sep 25, 2020: ActEV'21 SDL KF with Known Activities opens
Summary
The Activities in Extended Video (ActEV) series of evaluations is designed to accelerate development of robust, multi-camera, automatic activity detection systems in known/unknown facilities for forensic and real-time alerting applications.

The ActEV 2021 Sequestered Data Leaderboard (ActEV’21 SDL) includes two separate evaluations of real-time or faster activity detection systems:

  • A Known Facility (KF) evaluation with Electro-Optical (EO)/Infrared (IR) modalities
  • An Unknown Facility (UF) evaluation with Known/Surprise activities

Systems submitted to the SDL are expected to process video in real-time or faster. Scores for systems operating slower than real-time will be computed from the output generated before the real-time clock expires per the Metrics section below.

What
Participants are invited to submit their runnable activity detection software using an ActEV Command Line Interface (CLI) submission. There are two leaderboards (KF and UF) with sub-leaderboards as follows:
  • UF: Unknown Facilities Leaderboards
    • UF Known Activities on EO
    • UF Surprise Activities on EO
  • KF: Known Facilities Leaderboards
    • KF Known Activities on EO
    • KF Known Activities on IR

Participants may submit systems that address only a single sub-leaderboard task as described in the evaluation plan below. NIST will evaluate system performance on sequestered data using NIST hardware and results will be posted to a public leaderboard.

Who
Everyone. Anyone who registers can submit to the evaluation server.
How
Register here and then follow the instructions on the Algorithm Submission tab above.

Systems must follow a NIST-defined CLI and automatically run on NIST’s servers, both of which are described in the instructions.

Evaluation Task
In the ActEV'21 SDL evaluation, there is one Activity Detection (AD) task which is defined as: given a target activity, a system automatically detects and temporally localizes all instances of the activity. For a system-identified activity instance to be evaluated as correct, the type of activity must be correct, and the temporal overlap must fall within a minimal requirement.
Data
The ActEV'21 SDL evaluation is based on the KF and UF datasets. The KF and UF data were collected and annotated for the Intelligence Advanced Research Projects Activity (IARPA) Deep Intermodal Video Analytics (DIVA) program.

You can download the public MEVA dataset for free at mevadata.org. We also provide annotations for 27 hours of MEVA data, and instructions on how to make and share activity annotations are at mevadata.org.

Metrics
Submitted systems are measured by Probability of Missed Detection (Pmiss) and Time-based False Alarm (TFA). Pmiss is the portion of activities where the system did not detect the activity for at least 1 second. TFA is the portion of time that the system detected an activity when in fact there was none. Submitted systems are scored for Pmiss and TFA at multiple thresholds (based on confidence scores produced by the systems), creating a detection error tradeoff (DET).

The ActEV ’21 SDL Leaderboard will report scores on how systems would perform in real-time. If an SDL system takes longer than real-time to process test videos, NIST will score the system as if execution stopped where the runtime exceeded real time. The leaderboard ranking of a system is based on the scores as follows:
  • Time limited partial AUDC for the public leaderboard ranking
  • Time limited mean Pmiss at TFA = 0.02 for IARPA DIVA program ranking

Please see details in the ActEV'21 SDL evaluation plan below or check out the ActEV Scoring Software GitHub repo.

Evaluation Plan
Contact

For ActEV Evaluation information, please email: actev-nist@nist.gov

For ActEV Evaluation Discussion, please visit our Google Group.

News
21Sep
ActEV'21 SDL UF (with KA) Leaderboard starts
25Sep
ActEV'21 SDL KF Leaderboard starts
27Nov
Deadline to submit system for WACV'21 HADCV workshop

ActEV'21 SDL Evaluation Schedule
Sep 21, 2020: ActEV'21 SDL UF (with Known Activities) leaderboard opens
Sep 25, 2020: ActEV'21 SDL KF with EO (Electro-Optical) and IR (Infrared) leaderboards open

Nov 27, 2020 : Deadline for UF CLI submissions to be included in WACV'21 HADCV workshop.
Dec 20, 2020 : Top two teams on the ActEV'21 SDL UF (with Known Activities) leaderboard invited to give oral presentations at the WACV'21 HADCV workshop based on the CLI submission deadline (Nov 27, 2020).

Jan 05, 2021: WACV'21 HADCV workshop

Leaderboard Remains Open: Leaderboard will continue to remain open to allow participants to show continued progress on the challenging problem.
ActEV SDL Dataset

The ActEV SDL evaluation is based on the Known Facility (KF) and Unknown Facility (UF) datasets. The KF data was collected at the Muscatatuck Urban Training Center (MUTC) with a team of over 100 actors performing in various scenarios. The KF dataset has two parts: (1) the public training and development data and (2) sequestered evaluation data used by NIST to test systems. The UF data is a sequestered evaluation data which was collected at different places and includes both known and surprise activities.

The KF and UF data were collected and annotated for the Intelligence Advanced Research Projects Activity (IARPA) Deep Intermodal Video Analytics (DIVA) program. A primary goal of the DIVA program is to support activity detection in multi-camera environments for both DIVA performers and the broader research community.

Training and Development Data

The public KF dataset has been released as the Multiview Extended Video with Activities (MEVA) dataset. As of December 2019, 328 hours of ground-camera data and 4.2 hours of Unmanned Arial Vehicle video have been released. 28 hours of the ground camera video have been annotated by the same team that has annotated the ActEV test set. Additional annotations have been performed by the public and are also available in the annotation repository.

Sequestered Data

The KF test set is a 140-hour collection of videos which consists of both EO and IR camera modalities, public cameras (video from the cameras and associated metadata are in the public training set) and non-public cameras (video is not provided on metadata.org and camera parameters are only provided to the systems at test time). The KF leaderboard presents results on the full 140-hour collection reporting separately for EO and IR data. Developers receive additional scores by activity for the EO_Set1 and the IR_Set1. The EO-Set1 and IR-Set1 are subsets of the entire test sets. For example, EO-Set1 is a random 50% of the EO data from public cameras and likewise for IR-Set1.

The UF test set has a large collection of videos exclusively in the EO spectrum (as of September 9, 2020). The UF leaderboard presents results separately for known activity and surprise activity types.

Data Download

You can download the public MEVA video and annotations dataset for free from the mevadata.org website (http://mevadata.org/)

Then complete these steps:

  • Get an up-to-date copy of the ActEV Data Repo via GIT. You'll need to either clone the repo (the first time you access it) or update a previously downloaded repo with 'git pull'.
    • Clone: git clone https://gitlab.kitware.com/actev/actev-data-repo.git
    • Update: cd "Your_Directory_For_actev-data-repo"; git pull
  • Get an up-to-date copy of the MEVA Data Repo via GIT. You'll need to either clone the repo (the first time you access it) or update a previously downloaded repo with 'git pull'.
    • Clone: git clone https://gitlab.kitware.com/meva/meva-data-repo
    • Update: cd "Your_Directory_For_meva-data-repo"; git pull
ActEV'21 SDL Leaderboard

Update Dec. 4, 2020: Reported scores for the UF Surprise Activity systems are preliminary scores. NIST is continuing to review the scoring protocol and reported Surprise Activity Scores.

UF Known Activities – EO

Updated: 2020-12-04 17:01:16 -0500
RANK SCORING_SUBMISSION_ID SCORING REQUEST NAME TEAM NAME SUBMISSION ID SUBMISSION DATE SYSTEM NAME SYSTEM ID SCORING PROTOCOL TIME LIMITED PARTIAL AUDC* RELATIVE PROCESSING TIME DETECTED ACTIVITY TYPES† PROCESSED FILES‡ TIME LIMITED MEAN-P_MISS@0.02TFA
1 22926 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00283_INF_20201203-231326-4911.sr-20201203-231327-5952 INF submission_description/22923|22923 2020-12-03 INF_MEVA1 283 ActEV_SDL_V2 0.42810 0.661 100% 100% 0.63794
2 22909 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201202-051833-1359.sr-20201202-051834-2573 CMU-DIVA submission_description/22899|22899 2020-12-01 UF_EO 360 ActEV_SDL_V2 0.45158 0.661 100% 100% 0.64668
3 22300 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201008-045827-1393.sr-20201008-045828-4137 TeamVision2 submission_description/22299|22299 2020-10-07 dummy_test 346 ActEV_SDL_V2 0.55066 0.573 100% 100% 0.78811
4 22361 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201015-195438-2537.sr-20201015-195439-3240 IBM-MIT-Purdue submission_description/22353|22353 2020-10-15 IBM-Purdue 345 ActEV_SDL_V2 0.55792 0.348 100% 100% 0.79406
5 22525 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201028-182314-5695.sr-20201028-182315-6243 IBM-Purdue submission_description/22519|22519 2020-10-28 Purdue 363 ActEV_SDL_V2 0.55793 0.209 100% 100% 0.79406
6 22492 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201027-003708-4507.sr-20201027-003709-4666 UCF submission_description/22463|22463 2020-10-23 UCF-P 270 ActEV_SDL_V2 0.56252 0.695 100% 100% 0.73278
7 22674 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201113-074723-3459.sr-20201113-074724-2350 UMD submission_description/22673|22673 2020-11-12 UMD_JHU 356 ActEV_SDL_V2 0.67228 0.803 97% 100% 0.79072
8 22725 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00376_MINDS-JHU_20201123-170542-6699.sr-20201123-170543-6642 MINDS_JHU submission_description/22720|22720 2020-11-22 jhu_stmpgnn2 376 ActEV_SDL_V2 0.89128 2.054 100% 93% 0.94754
9 22682 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20201116-173850-2017.sr-20201116-173851-1610 NIST-TEST submission_description/22679|22679 2020-11-16 NIST Test 263 ActEV_SDL_V2 1.00000 0.028 0% 100% 1.00000

Updated: 2020-12-04 17:01:16 -0500

UF Surprise Activities – EO

Updated: 2020-12-04 17:01:18 -0500
RANK SCORING_SUBMISSION_ID SCORING REQUEST NAME TEAM NAME SUBMISSION ID SUBMISSION DATE SYSTEM NAME SYSTEM ID SCORING PROTOCOL TIME LIMITED PARTIAL AUDC* RELATIVE PROCESSING TIME DETECTED ACTIVITY TYPES† PROCESSED FILES‡ TIME LIMITED MEAN-P_MISS@0.02TFA
1 22900 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201201-182032-5366.sr-20201201-182033-7892 IBM-Purdue submission_description/22729|22729 2020-11-24 Purdue 363 ActEV_SDL_V2 0.63184 0.209 100% 100% 0.85365
2 22339 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201014-065242-7512.sr-20201014-065244-0291 IBM-MIT-Purdue submission_description/22335|22335 2020-10-13 IBM-Purdue 345 ActEV_SDL_V2 1.00000 0.414 0% 100% 1.00000
3 22926 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00283_INF_20201203-231326-4911.sr-20201203-231327-8325 INF submission_description/22923|22923 2020-12-03 INF_MEVA1 283 ActEV_SDL_V2 1.00000 0.661 0% 100% 1.00000
4 22221 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20200921-183814-7260.sr-20200921-183837-5900 NIST-TEST submission_description/22220|22220 2020-09-21 NIST Test 263 ActEV_SDL_V2 1.00000 0.027 0% 100% 1.00000
5 22922 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201202-192902-7091.sr-20201202-192903-9132 TeamVision2 submission_description/22913|22913 2020-12-02 IBM_EO 365 ActEV_SDL_V2 1.00000 0.396 0% 100% 1.00000
6 22533 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201029-160036-7064.sr-20201029-160037-8949 UCF submission_description/22532|22532 2020-10-29 UCF-P 270 ActEV_SDL_V2 1.00000 0.733 0% 78% 1.00000
7 22347 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201014-182844-3707.sr-20201014-182845-4175 CMU-DIVA submission_description/22343|22343 2020-10-14 UF_EO 360 ActEV_SDL_V2 1.00000 0.033 0% 100% 1.00000
8 22674 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201113-074723-3459.sr-20201113-074724-4402 UMD submission_description/22673|22673 2020-11-12 UMD_JHU 356 ActEV_SDL_V2 1.00000 0.803 0% 100% 1.00000

Updated: 2020-12-04 17:01:18 -0500

UF Known Activities – EO

Updated: 2020-12-04 17:01:16 -0500
RANK SCORING_SUBMISSION_ID SCORING REQUEST NAME TEAM NAME SUBMISSION ID SUBMISSION DATE SYSTEM NAME SYSTEM ID SCORING PROTOCOL TIME LIMITED PARTIAL AUDC* RELATIVE PROCESSING TIME DETECTED ACTIVITY TYPES† PROCESSED FILES‡ TIME LIMITED MEAN-P_MISS@0.02TFA
1 22926 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00283_INF_20201203-231326-4911.sr-20201203-231327-5952 INF submission_description/22923|22923 2020-12-03 INF_MEVA1 283 ActEV_SDL_V2 0.42810 0.661 100% 100% 0.63794
2 22909 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201202-051833-1359.sr-20201202-051834-2573 CMU-DIVA submission_description/22899|22899 2020-12-01 UF_EO 360 ActEV_SDL_V2 0.45158 0.661 100% 100% 0.64668
3 22579 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201102-214455-8304.sr-20201102-214457-0479 CMU-DIVA submission_description/22574|22574 2020-11-02 UF_EO 360 ActEV_SDL_V2 0.48216 0.583 100% 100% 0.71713
4 22558 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201101-025413-2320.sr-20201101-025414-3678 CMU-DIVA submission_description/22557|22557 2020-10-31 test1 284 ActEV_SDL_V2 0.48222 0.582 100% 100% 0.71673
5 22563 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201101-224747-1382.sr-20201101-224748-2080 CMU-DIVA submission_description/22559|22559 2020-11-01 test1 284 ActEV_SDL_V2 0.50079 0.530 100% 100% 0.72963
6 22687 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201118-124410-6108.sr-20201118-124412-2294 CMU-DIVA submission_description/22675|22675 2020-11-15 test1 284 ActEV_SDL_V2 0.51758 0.925 100% 100% 0.76470
7 22451 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201023-080021-8486.sr-20201023-080022-9400 CMU-DIVA submission_description/22446|22446 2020-10-22 UF_EO 360 ActEV_SDL_V2 0.51884 0.920 100% 100% 0.73637
8 22551 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201031-100428-1840.sr-20201031-100429-3133 CMU-DIVA submission_description/22541|22541 2020-10-30 test1 284 ActEV_SDL_V2 0.51890 0.581 100% 100% 0.73647
9 22848 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201201-063027-9910.sr-20201201-063029-0614 CMU-DIVA submission_description/22846|22846 2020-11-30 UF_EO 360 ActEV_SDL_V2 0.52090 0.644 100% 100% 0.74626
10 22300 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201008-045827-1393.sr-20201008-045828-4137 TeamVision2 submission_description/22299|22299 2020-10-07 dummy_test 346 ActEV_SDL_V2 0.55066 0.573 100% 100% 0.78811
11 22361 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201015-195438-2537.sr-20201015-195439-3240 IBM-MIT-Purdue submission_description/22353|22353 2020-10-15 IBM-Purdue 345 ActEV_SDL_V2 0.55792 0.348 100% 100% 0.79406
12 22399 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201019-230753-1014.sr-20201019-230754-0507 IBM-MIT-Purdue submission_description/22392|22392 2020-10-19 IBM-Purdue 345 ActEV_SDL_V2 0.55793 0.382 100% 100% 0.79406
13 22236 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20200924-171316-6384.sr-20200924-171317-7720 IBM-MIT-Purdue submission_description/22235|22235 2020-09-24 IBM-Purdue 345 ActEV_SDL_V2 0.55793 0.494 100% 100% 0.79406
14 22525 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201028-182314-5695.sr-20201028-182315-6243 IBM-Purdue submission_description/22519|22519 2020-10-28 Purdue 363 ActEV_SDL_V2 0.55793 0.209 100% 100% 0.79406
15 22523 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201028-154242-4838.sr-20201028-154243-7693 IBM-Purdue submission_description/22515|22515 2020-10-28 Purdue 363 ActEV_SDL_V2 0.55793 0.208 100% 100% 0.79406
16 22339 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201014-065242-7512.sr-20201014-065243-8244 IBM-MIT-Purdue submission_description/22335|22335 2020-10-13 IBM-Purdue 345 ActEV_SDL_V2 0.55793 0.414 100% 100% 0.79406
17 22474 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201026-133556-0027.sr-20201026-133557-0277 TeamVision2 submission_description/22447|22447 2020-10-22 IBM_EO 365 ActEV_SDL_V2 0.56057 0.605 100% 100% 0.78677
18 22531 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201029-030956-0330.sr-20201029-030957-0388 IBM-Purdue submission_description/22528|22528 2020-10-28 Purdue 363 ActEV_SDL_V2 0.56065 0.165 100% 100% 0.79882
19 22492 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201027-003708-4507.sr-20201027-003709-4666 UCF submission_description/22463|22463 2020-10-23 UCF-P 270 ActEV_SDL_V2 0.56252 0.695 100% 100% 0.73278
20 22671 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201110-033349-5068.sr-20201110-033350-6086 IBM-Purdue submission_description/22670|22670 2020-11-09 Purdue 363 ActEV_SDL_V2 0.56379 0.225 100% 100% 0.82707
21 22722 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201123-134032-5283.sr-20201123-134047-6196 UCF submission_description/22697|22697 2020-11-21 UCF-P 270 ActEV_SDL_V2 0.56407 0.589 100% 100% 0.73924
22 22847 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201130-214716-4425.sr-20201130-214717-4282 TeamVision2 submission_description/22842|22842 2020-11-30 IBM_EO 365 ActEV_SDL_V2 0.56730 0.370 100% 100% 0.79952
23 22661 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201106-210839-4737.sr-20201106-210840-6203 TeamVision2 submission_description/22641|22641 2020-11-05 IBM_EO 365 ActEV_SDL_V2 0.56732 0.347 100% 100% 0.82746
24 22529 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201029-003835-1227.sr-20201029-003836-1508 IBM-Purdue submission_description/22527|22527 2020-10-28 Purdue 363 ActEV_SDL_V2 0.56757 0.304 100% 100% 0.81492
25 22445 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201022-171801-8897.sr-20201022-171802-9059 TeamVision2 submission_description/22436|22436 2020-10-21 IBM_EO 365 ActEV_SDL_V2 0.57433 0.332 100% 100% 0.78902
26 22421 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201021-063847-1073.sr-20201021-063848-0805 TeamVision2 submission_description/22413|22413 2020-10-20 IBM_EO 365 ActEV_SDL_V2 0.57808 0.364 100% 100% 0.80689
27 22359 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201015-153504-8081.sr-20201015-153505-8305 TeamVision2 submission_description/22352|22352 2020-10-15 dummy_test 346 ActEV_SDL_V2 0.58210 0.343 100% 100% 0.80472
28 22667 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201109-212149-9820.sr-20201109-212151-0019 TeamVision2 submission_description/22664|22664 2020-11-09 IBM_EO 365 ActEV_SDL_V2 0.58452 0.346 100% 100% 0.84021
29 22533 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201029-160036-7064.sr-20201029-160037-6775 UCF submission_description/22532|22532 2020-10-29 UCF-P 270 ActEV_SDL_V2 0.58715 0.733 100% 78% 0.74076
30 22495 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-022903-2426.sr-20201027-022904-2627 IBM-Purdue submission_description/22484|22484 2020-10-26 Purdue 363 ActEV_SDL_V2 0.58717 0.184 100% 100% 0.81779
31 22496 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-064127-6501.sr-20201027-064128-6333 IBM-Purdue submission_description/22485|22485 2020-10-26 Purdue 363 ActEV_SDL_V2 0.59030 0.309 100% 100% 0.82535
32 22663 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00348_TeamVision2_20201107-124641-0766.sr-20201107-124642-0578 TeamVision2 submission_description/22643|22643 2020-11-05 dummy_test 348 ActEV_SDL_V2 0.59868 0.344 100% 100% 0.84838
33 22721 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201123-133606-3163.sr-20201123-133625-2758 TeamVision2 submission_description/22691|22691 2020-11-19 IBM_EO 365 ActEV_SDL_V2 0.61194 0.380 100% 100% 0.85007
34 22728 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201124-052822-1903.sr-20201124-052823-1953 TeamVision2 submission_description/22727|22727 2020-11-23 IBM_EO 365 ActEV_SDL_V2 0.61194 0.380 100% 100% 0.85007
35 22227 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20200922-100028-5011.sr-20200922-100029-5888 TeamVision2 submission_description/22223|22223 2020-09-21 dummy_test 346 ActEV_SDL_V2 0.61507 1.003 100% 100% 0.82133
36 22337 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201014-000127-6837.sr-20201014-000128-6712 IBM-MIT-Purdue submission_description/22334|22334 2020-10-13 IBM-Purdue 345 ActEV_SDL_V2 0.61808 0.185 100% 100% 0.83571
37 22553 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201031-133106-2096.sr-20201031-133107-2093 IBM-Purdue submission_description/22548|22548 2020-10-30 Purdue 363 ActEV_SDL_V2 0.62341 0.112 100% 100% 0.81779
38 22508 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-180234-7954.sr-20201027-180235-8780 IBM-Purdue submission_description/22502|22502 2020-10-27 Purdue 363 ActEV_SDL_V2 0.63470 0.228 100% 100% 0.84867
39 22291 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201006-210200-3176.sr-20201006-210201-3530 CMU-DIVA submission_description/22286|22286 2020-10-06 UF_EO 360 ActEV_SDL_V2 0.63604 0.161 100% 100% 0.74423
40 22257 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20200929-182035-3866.sr-20200929-182037-3303 CMU-DIVA submission_description/22256|22256 2020-09-29 test1 284 ActEV_SDL_V2 0.63604 0.177 100% 100% 0.74425
41 22357 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201015-122605-6683.sr-20201015-122627-6978 CMU-DIVA submission_description/22346|22346 2020-10-14 UF_EO 360 ActEV_SDL_V2 0.63804 0.183 100% 96% 0.75891
42 22419 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201021-011240-7462.sr-20201021-011241-8836 CMU-DIVA submission_description/22409|22409 2020-10-20 UF_EO 360 ActEV_SDL_V2 0.63917 0.135 100% 100% 0.74477
43 22497 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-084920-5177.sr-20201027-084921-6056 IBM-Purdue submission_description/22490|22490 2020-10-27 Purdue 363 ActEV_SDL_V2 0.64176 0.168 100% 100% 0.85627
44 22724 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201123-135017-8483.sr-20201123-135037-1687 TeamVision2 submission_description/22692|22692 2020-11-19 dummy_test 346 ActEV_SDL_V2 0.64192 0.370 100% 100% 0.86282
45 22499 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-104311-4588.sr-20201027-104313-2539 IBM-Purdue submission_description/22491|22491 2020-10-27 Purdue 363 ActEV_SDL_V2 0.64236 0.138 100% 91% 0.85127
46 22509 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-215042-5874.sr-20201027-215043-7002 IBM-Purdue submission_description/22503|22503 2020-10-27 Purdue 363 ActEV_SDL_V2 0.64282 0.289 100% 100% 0.84764
47 22231 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20200922-212038-5389.sr-20200922-212039-6503 CMU-DIVA submission_description/22230|22230 2020-09-22 test1 284 ActEV_SDL_V2 0.64309 0.214 100% 100% 0.75093
48 22500 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-122714-9767.sr-20201027-122716-0285 IBM-Purdue submission_description/22493|22493 2020-10-27 Purdue 363 ActEV_SDL_V2 0.65044 0.107 100% 100% 0.85976
49 22234 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20200924-032335-4332.sr-20200924-032336-3845 TeamVision2 submission_description/22232|22232 2020-09-23 dummy_test 346 ActEV_SDL_V2 0.65629 1.039 100% 100% 0.83767
50 22521 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201028-123711-6877.sr-20201028-123712-7878 CMU-DIVA submission_description/22510|22510 2020-10-27 UF_EO 360 ActEV_SDL_V2 0.65917 0.087 100% 100% 0.76046
51 22504 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-134906-4379.sr-20201027-134907-4063 IBM-Purdue submission_description/22494|22494 2020-10-27 Purdue 363 ActEV_SDL_V2 0.66454 0.077 100% 100% 0.87599
52 22674 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201113-074723-3459.sr-20201113-074724-2350 UMD submission_description/22673|22673 2020-11-12 UMD_JHU 356 ActEV_SDL_V2 0.67228 0.803 97% 100% 0.79072
53 22568 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201102-031021-8989.sr-20201102-031023-0988 CMU-DIVA submission_description/22564|22564 2020-11-02 test1 284 ActEV_SDL_V2 0.69104 0.098 100% 100% 0.78737
54 22875 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201201-113723-2477.sr-20201201-113724-3351 IBM-Purdue submission_description/22704|22704 2020-11-21 Purdue 363 ActEV_SDL_V2 0.70139 0.196 100% 100% 0.86483
55 22844 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201130-182149-4376.sr-20201130-182150-4880 IBM-Purdue submission_description/22729|22729 2020-11-24 Purdue 363 ActEV_SDL_V2 0.71667 0.198 100% 100% 0.87310
56 22573 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201102-132404-1906.sr-20201102-132405-2202 UMD submission_description/22542|22542 2020-10-30 UMD_JHU 356 ActEV_SDL_V2 0.71872 1.052 100% 100% 0.84291
57 22401 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201020-102552-6358.sr-20201020-102553-7574 CMU-DIVA submission_description/22395|22395 2020-10-19 UF_EO 360 ActEV_SDL_V2 0.72702 0.934 100% 100% 0.87012
58 22620 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201104-104036-9821.sr-20201104-104037-9587 UMD submission_description/22575|22575 2020-11-02 UMD_JHU 356 ActEV_SDL_V2 0.73220 1.045 100% 100% 0.84608
59 22443 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201022-142224-9861.sr-20201022-142226-0372 CMU-DIVA submission_description/22426|22426 2020-10-21 test1 284 ActEV_SDL_V2 0.78953 1.624 100% 100% 0.87401
60 22552 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201031-114836-0026.sr-20201031-114837-1047 IBM-Purdue submission_description/22547|22547 2020-10-30 Purdue 363 ActEV_SDL_V2 0.81298 0.174 48% 100% 0.92733
61 22381 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201018-214803-9079.sr-20201018-214804-8806 CMU-DIVA submission_description/22380|22380 2020-10-18 UF_EO 360 ActEV_SDL_V2 0.81929 0.229 100% 100% 0.87986
62 22288 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201006-180832-1698.sr-20201006-180833-0612 CMU-DIVA submission_description/22285|22285 2020-10-06 test1 284 ActEV_SDL_V2 0.83422 0.094 100% 100% 0.85825
63 22316 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201010-025947-6485.sr-20201010-025948-6713 CMU-DIVA submission_description/22314|22314 2020-10-09 UF_EO 360 ActEV_SDL_V2 0.85700 0.086 100% 100% 0.88755
64 22631 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201104-171141-8529.sr-20201104-171142-8703 UMD submission_description/22263|22263 2020-10-01 UMD_JHU 356 ActEV_SDL_V2 0.85710 2.292 100% 83% 0.91084
65 22375 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201018-030251-3023.sr-20201018-030252-2188 CMU-DIVA submission_description/22371|22371 2020-10-17 UF_EO 360 ActEV_SDL_V2 0.87838 0.146 100% 95% 0.89110
66 22869 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201201-105937-6602.sr-20201201-105938-7410 TeamVision2 submission_description/22731|22731 2020-11-24 IBM_EO 365 ActEV_SDL_V2 0.88258 0.297 100% 28% 0.94091
67 22725 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00376_MINDS-JHU_20201123-170542-6699.sr-20201123-170543-6642 MINDS_JHU submission_description/22720|22720 2020-11-22 jhu_stmpgnn2 376 ActEV_SDL_V2 0.89128 2.054 100% 93% 0.94754
68 22350 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201015-015701-0784.sr-20201015-015702-1842 CMU-DIVA submission_description/22348|22348 2020-10-14 UF_EO 360 ActEV_SDL_V2 0.89740 0.728 100% 3% 0.90409
69 22368 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201016-220648-1439.sr-20201016-220649-1049 CMU-DIVA submission_description/22358|22358 2020-10-15 UF_EO 360 ActEV_SDL_V2 0.89740 1.439 100% 3% 0.90408
70 22811 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201130-125141-9855.sr-20201130-125142-9758 CMU-DIVA submission_description/22311|22311 2020-10-09 UF_EO 360 ActEV_SDL_V2 0.91031 0.057 100% 60% 0.91749
71 22296 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201007-145144-2275.sr-20201007-145147-7610 CMU-DIVA submission_description/22290|22290 2020-10-06 test1 284 ActEV_SDL_V2 0.96310 0.067 100% 100% 0.96454
72 22385 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201019-013410-0204.sr-20201019-013411-0095 CMU-DIVA submission_description/22382|22382 2020-10-18 UF_EO 360 ActEV_SDL_V2 0.97526 0.111 100% 100% 0.97693
73 22379 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201018-170431-3773.sr-20201018-170432-3461 CMU-DIVA submission_description/22378|22378 2020-10-18 UF_EO 360 ActEV_SDL_V2 0.97532 0.026 100% 92% 0.97505
74 22278 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201006-024757-4962.sr-20201006-024758-4544 CMU-DIVA submission_description/22276|22276 2020-10-05 test1 284 ActEV_SDL_V2 0.98055 0.066 100% 100% 0.98134
75 22665 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201109-160519-0156.sr-20201109-160519-9890 TeamVision2 submission_description/22642|22642 2020-11-05 dummy_test 346 ActEV_SDL_V2 0.98092 0.345 100% 100% 0.98245
76 22843 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201130-172517-4392.sr-20201130-172518-4377 TeamVision2 submission_description/22732|22732 2020-11-24 dummy_test 346 ActEV_SDL_V2 0.98472 0.811 100% 3% 0.98453
77 22347 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201014-182844-3707.sr-20201014-182845-3229 CMU-DIVA submission_description/22343|22343 2020-10-14 UF_EO 360 ActEV_SDL_V2 0.99415 0.033 100% 100% 0.99414
78 22622 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20201104-130400-3038.sr-20201104-130401-2955 NIST-TEST submission_description/22621|22621 2020-11-04 NIST Test 263 ActEV_SDL_V2 1.00000 0.029 0% 100% 1.00000
79 22460 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201023-111512-7681.sr-20201023-111513-6654 UMD submission_description/22449|22449 2020-10-23 UMD_JHU 356 ActEV_SDL_V2 1.00000 0.140 0% 100% 1.00000
80 22486 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201026-203246-5156.sr-20201026-203247-4572 CMU-DIVA submission_description/22475|22475 2020-10-26 test1 284 ActEV_SDL_V2 1.00000 0.184 0% 100% 1.00000
81 22221 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20200921-183814-7260.sr-20200921-183837-2768 NIST-TEST submission_description/22220|22220 2020-09-21 NIST Test 263 ActEV_SDL_V2 1.00000 0.027 0% 100% 1.00000
82 22516 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201028-024210-0105.sr-20201028-024210-9423 CMU-DIVA submission_description/22505|22505 2020-10-27 test1 284 ActEV_SDL_V2 1.00000 0.395 0% 100% 1.00000
83 22309 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201009-175733-5335.sr-20201009-175734-4603 CMU-DIVA submission_description/22308|22308 2020-10-09 UF_EO 360 ActEV_SDL_V2 1.00000 0.006 0% 100% 1.00000
84 22224 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20200921-213708-3727.sr-20200921-213709-3687 NIST-TEST submission_description/22222|22222 2020-09-21 NIST Test 263 ActEV_SDL_V2 1.00000 0.028 0% 0% 1.00000
85 22682 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20201116-173850-2017.sr-20201116-173851-1610 NIST-TEST submission_description/22679|22679 2020-11-16 NIST Test 263 ActEV_SDL_V2 1.00000 0.028 0% 100% 1.00000

Updated: 2020-12-04 17:01:16 -0500

UF Surprise Activities – EO

Updated: 2020-12-04 17:01:18 -0500
RANK SCORING_SUBMISSION_ID SCORING REQUEST NAME TEAM NAME SUBMISSION ID SUBMISSION DATE SYSTEM NAME SYSTEM ID SCORING PROTOCOL TIME LIMITED PARTIAL AUDC* RELATIVE PROCESSING TIME DETECTED ACTIVITY TYPES† PROCESSED FILES‡ TIME LIMITED MEAN-P_MISS@0.02TFA
1 22900 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201201-182032-5366.sr-20201201-182033-7892 IBM-Purdue submission_description/22729|22729 2020-11-24 Purdue 363 ActEV_SDL_V2 0.63184 0.209 100% 100% 0.85365
2 22898 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201201-150148-6301.sr-20201201-150150-0082 IBM-Purdue submission_description/22704|22704 2020-11-21 Purdue 363 ActEV_SDL_V2 0.70615 0.203 100% 100% 0.91812
3 22227 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20200922-100028-5011.sr-20200922-100030-1286 TeamVision2 submission_description/22223|22223 2020-09-21 dummy_test 346 ActEV_SDL_V2 1.00000 1.003 0% 100% 1.00000
4 22231 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20200922-212038-5389.sr-20200922-212040-0527 CMU-DIVA submission_description/22230|22230 2020-09-22 test1 284 ActEV_SDL_V2 1.00000 0.214 0% 100% 1.00000
5 22234 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20200924-032335-4332.sr-20200924-032336-7121 TeamVision2 submission_description/22232|22232 2020-09-23 dummy_test 346 ActEV_SDL_V2 1.00000 1.039 0% 100% 1.00000
6 22236 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20200924-171316-6384.sr-20200924-171318-2292 IBM-MIT-Purdue submission_description/22235|22235 2020-09-24 IBM-Purdue 345 ActEV_SDL_V2 1.00000 0.494 0% 100% 1.00000
7 22257 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20200929-182035-3866.sr-20200929-182037-6243 CMU-DIVA submission_description/22256|22256 2020-09-29 test1 284 ActEV_SDL_V2 1.00000 0.177 0% 100% 1.00000
8 22631 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201104-171141-8529.sr-20201104-171143-0866 UMD submission_description/22263|22263 2020-10-01 UMD_JHU 356 ActEV_SDL_V2 1.00000 2.292 0% 83% 1.00000
9 22278 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201006-024757-4962.sr-20201006-024758-5591 CMU-DIVA submission_description/22276|22276 2020-10-05 test1 284 ActEV_SDL_V2 1.00000 0.066 0% 100% 1.00000
10 22288 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201006-180832-1698.sr-20201006-180833-1807 CMU-DIVA submission_description/22285|22285 2020-10-06 test1 284 ActEV_SDL_V2 1.00000 0.094 0% 100% 1.00000
11 22291 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201006-210200-3176.sr-20201006-210201-4590 CMU-DIVA submission_description/22286|22286 2020-10-06 UF_EO 360 ActEV_SDL_V2 1.00000 0.161 0% 100% 1.00000
12 22296 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201007-145144-2275.sr-20201007-145147-9172 CMU-DIVA submission_description/22290|22290 2020-10-06 test1 284 ActEV_SDL_V2 1.00000 0.067 0% 100% 1.00000
13 22300 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201008-045827-1393.sr-20201008-045828-5427 TeamVision2 submission_description/22299|22299 2020-10-07 dummy_test 346 ActEV_SDL_V2 1.00000 0.573 0% 100% 1.00000
14 22309 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201009-175733-5335.sr-20201009-175734-5568 CMU-DIVA submission_description/22308|22308 2020-10-09 UF_EO 360 ActEV_SDL_V2 1.00000 0.006 0% 100% 1.00000
15 22315 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201010-005742-0257.sr-20201010-005743-1568 CMU-DIVA submission_description/22311|22311 2020-10-09 UF_EO 360 ActEV_SDL_V2 1.00000 0.057 0% 60% 1.00000
16 22316 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201010-025947-6485.sr-20201010-025948-7755 CMU-DIVA submission_description/22314|22314 2020-10-09 UF_EO 360 ActEV_SDL_V2 1.00000 0.086 0% 100% 1.00000
17 22337 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201014-000127-6837.sr-20201014-000128-8122 IBM-MIT-Purdue submission_description/22334|22334 2020-10-13 IBM-Purdue 345 ActEV_SDL_V2 1.00000 0.185 0% 100% 1.00000
18 22339 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201014-065242-7512.sr-20201014-065244-0291 IBM-MIT-Purdue submission_description/22335|22335 2020-10-13 IBM-Purdue 345 ActEV_SDL_V2 1.00000 0.414 0% 100% 1.00000
19 22347 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201014-182844-3707.sr-20201014-182845-4175 CMU-DIVA submission_description/22343|22343 2020-10-14 UF_EO 360 ActEV_SDL_V2 1.00000 0.033 0% 100% 1.00000
20 22357 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201015-122605-6683.sr-20201015-122627-8314 CMU-DIVA submission_description/22346|22346 2020-10-14 UF_EO 360 ActEV_SDL_V2 1.00000 0.183 0% 96% 1.00000
21 22350 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201015-015701-0784.sr-20201015-015702-3005 CMU-DIVA submission_description/22348|22348 2020-10-14 UF_EO 360 ActEV_SDL_V2 1.00000 0.728 0% 3% 1.00000
22 22359 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201015-153504-8081.sr-20201015-153505-9436 TeamVision2 submission_description/22352|22352 2020-10-15 dummy_test 346 ActEV_SDL_V2 1.00000 0.343 0% 100% 1.00000
23 22361 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201015-195438-2537.sr-20201015-195439-4285 IBM-MIT-Purdue submission_description/22353|22353 2020-10-15 IBM-Purdue 345 ActEV_SDL_V2 1.00000 0.348 0% 100% 1.00000
24 22368 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201016-220648-1439.sr-20201016-220649-2437 CMU-DIVA submission_description/22358|22358 2020-10-15 UF_EO 360 ActEV_SDL_V2 1.00000 1.439 0% 3% 1.00000
25 22375 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201018-030251-3023.sr-20201018-030252-3223 CMU-DIVA submission_description/22371|22371 2020-10-17 UF_EO 360 ActEV_SDL_V2 1.00000 0.146 0% 95% 1.00000
26 22379 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201018-170431-3773.sr-20201018-170432-4478 CMU-DIVA submission_description/22378|22378 2020-10-18 UF_EO 360 ActEV_SDL_V2 1.00000 0.026 0% 92% 1.00000
27 22381 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201018-214803-9079.sr-20201018-214805-0075 CMU-DIVA submission_description/22380|22380 2020-10-18 UF_EO 360 ActEV_SDL_V2 1.00000 0.229 0% 100% 1.00000
28 22385 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201019-013410-0204.sr-20201019-013411-1068 CMU-DIVA submission_description/22382|22382 2020-10-18 UF_EO 360 ActEV_SDL_V2 1.00000 0.111 0% 100% 1.00000
29 22399 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00345_IBM-MIT-Purdue_20201019-230753-1014.sr-20201019-230754-1732 IBM-MIT-Purdue submission_description/22392|22392 2020-10-19 IBM-Purdue 345 ActEV_SDL_V2 1.00000 0.382 0% 100% 1.00000
30 22401 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201020-102552-6358.sr-20201020-102553-8604 CMU-DIVA submission_description/22395|22395 2020-10-19 UF_EO 360 ActEV_SDL_V2 1.00000 0.934 0% 100% 1.00000
31 22419 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201021-011240-7462.sr-20201021-011241-9916 CMU-DIVA submission_description/22409|22409 2020-10-20 UF_EO 360 ActEV_SDL_V2 1.00000 0.135 0% 100% 1.00000
32 22421 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201021-063847-1073.sr-20201021-063848-1825 TeamVision2 submission_description/22413|22413 2020-10-20 IBM_EO 365 ActEV_SDL_V2 1.00000 0.364 0% 100% 1.00000
33 22443 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201022-142224-9861.sr-20201022-142226-1607 CMU-DIVA submission_description/22426|22426 2020-10-21 test1 284 ActEV_SDL_V2 1.00000 1.624 0% 100% 1.00000
34 22445 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201022-171801-8897.sr-20201022-171803-0025 TeamVision2 submission_description/22436|22436 2020-10-21 IBM_EO 365 ActEV_SDL_V2 1.00000 0.332 0% 100% 1.00000
35 22451 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201023-080021-8486.sr-20201023-080023-0384 CMU-DIVA submission_description/22446|22446 2020-10-22 UF_EO 360 ActEV_SDL_V2 1.00000 0.920 0% 100% 1.00000
36 22474 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201026-133556-0027.sr-20201026-133557-1229 TeamVision2 submission_description/22447|22447 2020-10-22 IBM_EO 365 ActEV_SDL_V2 1.00000 0.605 0% 100% 1.00000
37 22460 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201023-111512-7681.sr-20201023-111513-7702 UMD submission_description/22449|22449 2020-10-23 UMD_JHU 356 ActEV_SDL_V2 1.00000 0.140 0% 100% 1.00000
38 22492 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201027-003708-4507.sr-20201027-003709-5683 UCF submission_description/22463|22463 2020-10-23 UCF-P 270 ActEV_SDL_V2 1.00000 0.695 0% 100% 1.00000
39 22486 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201026-203246-5156.sr-20201026-203247-5526 CMU-DIVA submission_description/22475|22475 2020-10-26 test1 284 ActEV_SDL_V2 1.00000 0.184 0% 100% 1.00000
40 22495 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-022903-2426.sr-20201027-022904-3618 IBM-Purdue submission_description/22484|22484 2020-10-26 Purdue 363 ActEV_SDL_V2 1.00000 0.184 0% 100% 1.00000
41 22496 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-064127-6501.sr-20201027-064128-7297 IBM-Purdue submission_description/22485|22485 2020-10-26 Purdue 363 ActEV_SDL_V2 1.00000 0.309 0% 100% 1.00000
42 22497 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-084920-5177.sr-20201027-084921-7381 IBM-Purdue submission_description/22490|22490 2020-10-27 Purdue 363 ActEV_SDL_V2 1.00000 0.168 0% 100% 1.00000
43 22499 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-104311-4588.sr-20201027-104313-4698 IBM-Purdue submission_description/22491|22491 2020-10-27 Purdue 363 ActEV_SDL_V2 1.00000 0.138 0% 91% 1.00000
44 22500 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-122714-9767.sr-20201027-122716-2588 IBM-Purdue submission_description/22493|22493 2020-10-27 Purdue 363 ActEV_SDL_V2 1.00000 0.107 0% 100% 1.00000
45 22504 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-134906-4379.sr-20201027-134907-6122 IBM-Purdue submission_description/22494|22494 2020-10-27 Purdue 363 ActEV_SDL_V2 1.00000 0.077 0% 100% 1.00000
46 22508 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-180234-7954.sr-20201027-180236-0965 IBM-Purdue submission_description/22502|22502 2020-10-27 Purdue 363 ActEV_SDL_V2 1.00000 0.228 0% 100% 1.00000
47 22509 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201027-215042-5874.sr-20201027-215043-9225 IBM-Purdue submission_description/22503|22503 2020-10-27 Purdue 363 ActEV_SDL_V2 1.00000 0.289 0% 100% 1.00000
48 22516 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201028-024210-0105.sr-20201028-024211-1544 CMU-DIVA submission_description/22505|22505 2020-10-27 test1 284 ActEV_SDL_V2 1.00000 0.395 0% 100% 1.00000
49 22521 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201028-123711-6877.sr-20201028-123712-9954 CMU-DIVA submission_description/22510|22510 2020-10-27 UF_EO 360 ActEV_SDL_V2 1.00000 0.087 0% 100% 1.00000
50 22523 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201028-154242-4838.sr-20201028-154244-0212 IBM-Purdue submission_description/22515|22515 2020-10-28 Purdue 363 ActEV_SDL_V2 1.00000 0.208 0% 100% 1.00000
51 22525 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201028-182314-5695.sr-20201028-182315-8258 IBM-Purdue submission_description/22519|22519 2020-10-28 Purdue 363 ActEV_SDL_V2 1.00000 0.209 0% 100% 1.00000
52 22529 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201029-003835-1227.sr-20201029-003836-3515 IBM-Purdue submission_description/22527|22527 2020-10-28 Purdue 363 ActEV_SDL_V2 1.00000 0.304 0% 100% 1.00000
53 22531 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201029-030956-0330.sr-20201029-030957-2364 IBM-Purdue submission_description/22528|22528 2020-10-28 Purdue 363 ActEV_SDL_V2 1.00000 0.165 0% 100% 1.00000
54 22533 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201029-160036-7064.sr-20201029-160037-8949 UCF submission_description/22532|22532 2020-10-29 UCF-P 270 ActEV_SDL_V2 1.00000 0.733 0% 78% 1.00000
55 22551 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201031-100428-1840.sr-20201031-100429-5084 CMU-DIVA submission_description/22541|22541 2020-10-30 test1 284 ActEV_SDL_V2 1.00000 0.581 0% 100% 1.00000
56 22573 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201102-132404-1906.sr-20201102-132405-4323 UMD submission_description/22542|22542 2020-10-30 UMD_JHU 356 ActEV_SDL_V2 1.00000 1.052 0% 100% 1.00000
57 22552 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201031-114836-0026.sr-20201031-114837-3222 IBM-Purdue submission_description/22547|22547 2020-10-30 Purdue 363 ActEV_SDL_V2 1.00000 0.174 0% 100% 1.00000
58 22553 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201031-133106-2096.sr-20201031-133107-4189 IBM-Purdue submission_description/22548|22548 2020-10-30 Purdue 363 ActEV_SDL_V2 1.00000 0.112 0% 100% 1.00000
59 22558 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201101-025413-2320.sr-20201101-025414-5855 CMU-DIVA submission_description/22557|22557 2020-10-31 test1 284 ActEV_SDL_V2 1.00000 0.582 0% 100% 1.00000
60 22563 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201101-224747-1382.sr-20201101-224748-4148 CMU-DIVA submission_description/22559|22559 2020-11-01 test1 284 ActEV_SDL_V2 1.00000 0.530 0% 100% 1.00000
61 22568 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201102-031021-8989.sr-20201102-031023-3349 CMU-DIVA submission_description/22564|22564 2020-11-02 test1 284 ActEV_SDL_V2 1.00000 0.098 0% 100% 1.00000
62 22579 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201102-214455-8304.sr-20201102-214457-2513 CMU-DIVA submission_description/22574|22574 2020-11-02 UF_EO 360 ActEV_SDL_V2 1.00000 0.583 0% 100% 1.00000
63 22620 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201104-104036-9821.sr-20201104-104038-1713 UMD submission_description/22575|22575 2020-11-02 UMD_JHU 356 ActEV_SDL_V2 1.00000 1.045 0% 100% 1.00000
64 22622 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20201104-130400-3038.sr-20201104-130401-5180 NIST-TEST submission_description/22621|22621 2020-11-04 NIST Test 263 ActEV_SDL_V2 1.00000 0.029 0% 100% 1.00000
65 22661 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201106-210839-4737.sr-20201106-210840-8625 TeamVision2 submission_description/22641|22641 2020-11-05 IBM_EO 365 ActEV_SDL_V2 1.00000 0.347 0% 100% 1.00000
66 22665 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00346_TeamVision2_20201109-160519-0156.sr-20201109-160520-2188 TeamVision2 submission_description/22642|22642 2020-11-05 dummy_test 346 ActEV_SDL_V2 1.00000 0.345 0% 100% 1.00000
67 22663 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00348_TeamVision2_20201107-124641-0766.sr-20201107-124642-2712 TeamVision2 submission_description/22643|22643 2020-11-05 dummy_test 348 ActEV_SDL_V2 1.00000 0.344 0% 100% 1.00000
68 22667 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201109-212149-9820.sr-20201109-212151-1974 TeamVision2 submission_description/22664|22664 2020-11-09 IBM_EO 365 ActEV_SDL_V2 1.00000 0.346 0% 100% 1.00000
69 22671 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201110-033349-5068.sr-20201110-033350-8087 IBM-Purdue submission_description/22670|22670 2020-11-09 Purdue 363 ActEV_SDL_V2 1.00000 0.225 0% 100% 1.00000
70 22674 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00356_UMD_20201113-074723-3459.sr-20201113-074724-4402 UMD submission_description/22673|22673 2020-11-12 UMD_JHU 356 ActEV_SDL_V2 1.00000 0.803 0% 100% 1.00000
71 22687 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00284_CMU-DIVA_20201118-124410-6108.sr-20201118-124412-5471 CMU-DIVA submission_description/22675|22675 2020-11-15 test1 284 ActEV_SDL_V2 1.00000 0.925 0% 100% 1.00000
72 22682 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20201116-173850-2017.sr-20201116-173851-4057 NIST-TEST submission_description/22679|22679 2020-11-16 NIST Test 263 ActEV_SDL_V2 1.00000 0.028 0% 100% 1.00000
73 22909 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00360_CMU-DIVA_20201202-051833-1359.sr-20201202-051834-5007 CMU-DIVA submission_description/22899|22899 2020-12-01 UF_EO 360 ActEV_SDL_V2 1.00000 0.661 0% 100% 1.00000
74 22922 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00365_TeamVision2_20201202-192902-7091.sr-20201202-192903-9132 TeamVision2 submission_description/22913|22913 2020-12-02 IBM_EO 365 ActEV_SDL_V2 1.00000 0.396 0% 100% 1.00000
75 22221 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20200921-183814-7260.sr-20200921-183837-5900 NIST-TEST submission_description/22220|22220 2020-09-21 NIST Test 263 ActEV_SDL_V2 1.00000 0.027 0% 100% 1.00000
76 22926 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00283_INF_20201203-231326-4911.sr-20201203-231327-8325 INF submission_description/22923|22923 2020-12-03 INF_MEVA1 283 ActEV_SDL_V2 1.00000 0.661 0% 100% 1.00000
77 22224 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20200921-213708-3727.sr-20200921-213709-6972 NIST-TEST submission_description/22222|22222 2020-09-21 NIST Test 263 ActEV_SDL_V2 1.00000 0.028 0% 0% 1.00000

Updated: 2020-12-04 17:01:18 -0500

KF Known Activities – EO

Updated: 2020-12-04 17:01:16 -0500
RANK SCORING_SUBMISSION_ID SCORING REQUEST NAME TEAM NAME SUBMISSION ID SUBMISSION DATE SYSTEM NAME SYSTEM ID SCORING PROTOCOL TIME LIMITED PARTIAL AUDC* RELATIVE PROCESSING TIME DETECTED ACTIVITY TYPES† PROCESSED FILES‡ TIME LIMITED MEAN-P_MISS@0.02TFA
1 22319 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00357_CMU-DIVA_20201011-052833-7613.sr-20201011-052835-4392 CMU-DIVA submission_description/22305|22305 2020-10-09 KF_EO 357 ActEV_SDL_V2 0.26935 0.480 100% 100% 0.53326
2 22465 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00270_UCF_20201024-225859-1143.sr-20201024-225900-7220 UCF submission_description/22462|22462 2020-10-23 UCF-P 270 ActEV_SDL_V2 0.35953 0.641 100% 100% 0.52284
3 22464 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201023-203407-8791.sr-20201023-203409-3608 IBM-Purdue submission_description/22461|22461 2020-10-23 Purdue 363 ActEV_SDL_V2 0.36094 0.125 100% 100% 0.59753
4 22524 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00349_UMCMU_20201028-171838-6161.sr-20201028-171840-2050 UMCMU submission_description/22476|22476 2020-10-26 UMCMU-T 349 ActEV_SDL_V2 0.45032 0.746 100% 100% 0.66570
5 22253 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20200929-004240-0098.sr-20200929-004241-5545 NIST-TEST submission_description/22249|22249 2020-09-28 NIST Test 263 ActEV_SDL_V2 1.00000 0.031 0% 100% 1.00000

Updated: 2020-12-04 17:01:16 -0500

KF Known Activities – IR

Updated: 2020-12-04 17:01:16 -0500
RANK SCORING_SUBMISSION_ID SCORING REQUEST NAME TEAM NAME SUBMISSION ID SUBMISSION DATE SYSTEM NAME SYSTEM ID SCORING PROTOCOL TIME LIMITED PARTIAL AUDC* RELATIVE PROCESSING TIME DETECTED ACTIVITY TYPES† PROCESSED FILES‡ TIME LIMITED MEAN-P_MISS@0.02TFA
1 22318 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00357_CMU-DIVA_20201010-090745-9902.sr-20201010-090747-9688 CMU-DIVA submission_description/22304|22304 2020-10-09 KF_EO 357 ActEV_SDL_V2 0.52667 0.477 100% 100% 0.71488
2 22437 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00363_IBM-Purdue_20201022-015722-7484.sr-20201022-015724-4129 IBM-Purdue submission_description/22402|22402 2020-10-20 Purdue 363 ActEV_SDL_V2 0.61553 0.104 100% 100% 0.82534
3 22524 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00349_UMCMU_20201028-171838-6161.sr-20201028-171840-6510 UMCMU submission_description/22476|22476 2020-10-26 UMCMU-T 349 ActEV_SDL_V2 0.67778 0.746 97% 100% 0.81071
4 22718 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00375_UCF_20201122-064211-9396.sr-20201122-064213-9502 UCF submission_description/22699|22699 2020-11-21 UCF-S 375 ActEV_SDL_V2 0.77440 0.574 94% 100% 0.85362
5 22252 ActEV-2018_AD_ActEV21-SDL-Scoring_SYS-00263_NIST-TEST_20200928-215848-6465.sr-20200928-215850-5334 NIST-TEST submission_description/22248|22248 2020-09-28 NIST Test 263 ActEV_SDL_V2 1.00000 0.029 0% 100% 1.00000

Updated: 2020-12-04 17:01:16 -0500