CVPR-NAS is an annual competition that compares how well Neural Search Architectures can apply machine learning methods to unseen datasets. Competitors must register with a website so that they can download a starting kit and datasets, then use these resources to complete their NAS algorithm.
Their code based entry is then uploaded to the same website which must then allocate resources and run their submitted code. This code run is time limited to one hour. There will only be a limited number of GPUs available to run the code, so jobs may be queued and executed in the order received.
Between 5-10 submissions are expected per day during the allowed submission period. Competitors will ideally have email notification of their code status. It is expected that code will be uploaded in a zip format.
A submission limit is set against each user, this should be zero at the beginning of the competition. A submission limit is set in the controllers/submision.js file. This can be updated as preferred and individual User limits can be changed (if necessary) through the Strapi admin content manager.
Stephen McGough - (stephen.mcgough@newcastle.ac.uk) Rob Geada - (rob@geada.net) David Towers - (d.towers2@newcastle.ac.uk) Nik Khadijah Nik Aznan - (nik.nik-aznan@newcastle.ac.uk) Amir Atapour-Abarghouei - (amir.atapour-abarghouei@durham.ac.uk)
Rebecca Osselton
Newcastle University
(rebecca.osselton@newcastle.ac.uk)
This is a back-end application that connects to a front-end created uisng Vue.js. CVPR-NAS-VUE. Strapi provides Browser based admin access using a registered username and password.
The competition has 3 stages. Users are able to upload zip files which are received by the Strapi back-end and recorded. Files are then passed to an Azure batch service with a unique id and run using specific datasets. Once the submissions have been executed via the batch pool, results are returned to the back-end and stored against the orignal submission. The website is able to query the back-end for each submission results and display a ranking of competitors based on runtimes and scores.
Node.js, yarn
Clone the repo into a suitable directory. Create an .env file containing the following variables:
ADMIN_JWT_SECRET= JWT_SECRET= API_TOKEN_SALT= STORAGE_ACCOUNT_NAME= STORAGE_ACCOUNT_KEY= STORAGE_CONTAINER_NAME= BATCH_ACCOUNT_NAME= BATCH_ACCOUNT_KEY= BATCH_ENDPOINT= SLACK_WEBHOOK= SENDGRID_API_KEY= DATABASE_PORT= DATABASE_SSL= DATABASE_NAME= DATABASE_USERNAME= DATABASE_PASSWORD= DATABASE_HOST= APP_KEYS= SENTRY_DSN= PUBLIC_URL= PUBLIC_ADMIN_URL=
SLACK_WEBHOOK is in development, currently not functional.
yarn start to start the Strapi admin application.
yarn develop will put the app in development mode and allow the change of the Content-Type objects
yarn build to build the application ready for deployment.
Main and dev only