Code for MSR 2019 Challenge paper submission
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Alexander Wong d3e511f59a
whatever
1 year ago
.vscode test 1 year ago
amir's stuff whatever 1 year ago
eval_untrusted huh 1 year ago
.gitignore huh 1 year ago
LICENSE Initial commit 1 year ago
README.md huh 1 year ago
init_challenge_db.sql saving messages too 1 year ago
main.R Merge branch 'master' of git.udia.ca:alex/msr-2019-analysis 1 year ago
prep_ids.py added gross docker subprocess code evaluation 1 year ago
requirements.txt pie 1 year ago

README.md

msr-2019-analysis

Code for MSR 2019 Challenge paper submission

Getting Started

  1. virtualenv venv --python=python3
  2. source venv/bin/activate
  3. pip install -r requirements.txt
  4. python3 prep_ids.py --help

Eval untrusted

$ docker build -t eval-untrusted .
$ docker run eval-untrusted --mount type=bind,source="$(pwd)"/eval_out,target=/eval_out

Random Sample Output

C: 69974, 162613025, None 19045; IndexError: 98; NameError: 33095; ModuleNotFoundError: 10397; TypeError: 560; _tkinter.TclError: 305; FileNotFoundError: 1432; SyntaxError: 1771; IndentationError: 1201; EOFError: 917; AttributeError: 271; HOST: TimeoutExpired 374; AssertionError: 9; OSError: 50; ImportError: 134; KeyError: 39; ValueError: 113; UnicodeEncodeError: 2; TabError: 47; ConnectionRefusedError: 14; RuntimeError: 9; UnboundLocalError: 15; webbrowser.Error: 2; sqlite3.OperationalError: 6; RecursionError: 8; smtplib.SMTPAuthenticationError: 5; ZeroDivisionError: 4; subprocess.CalledProcessError: 9; urllib.error.HTTPError: 5; locale.Error: 8; tarfile.ReadError: 1; NotImplementedError: 3; json.decoder.JSONDecodeError: 9; NotADirectoryError: 4; ReferenceError: 1; LookupError: 1; BrokenPipeError: 1; configparser.NoSectionError: 1; FileExistsError: 1; xml.etree.ElementTree.ParseError: 1; __main__.ValidationError: 1; _csv.Error: 2; _pickle.PicklingError: 1; PermissionError: 1; elapsed 0:20:32.539854