report

Test Results

iUnit TestScoreNotesOutput
1ID: 239eadbc
Label: test square
Target(s): square
1.0 / 1.0
✅ passed
stdout
FOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOO
stderr
2ID: f03691ea
 Label: test cube
 Target(s): cube
2.5 / 2.5
well done 👌
stdout
stderr
cube

3ID: 35797fb2
 Label: test abs_cube
 Target(s): abs_cube
2.0 / 3.0
¯\_(ツ)_/¯ partially passed
stdout
stderr
4ID: 7e0e6ff3
 Label: test constant
 Target(s): SOME_CONSTANT
1.0 / 2.0
at least you declared it 🥴
stdout
stderr
5ID: 90f0231e
 Label: test square & cube
 Target(s): square,cube
1.0 / 1.0
✅ passed
stdout
stderr
6ID: 85f2e613
 Label: test failure
 Target(s): fail
0 / 1.5
❌ ValueError: "no chance, this function crashes so badly"
stdout
stderr
Test failed:
Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_test.py", line 48, in __call__
    result = self._test_function(*targets, *args, **kwargs)
  File "/home/jovyan/work/jupyter-autograde/demo/test.py", line 65, in test_fail
    fail()
  File "/tmp/tmp5crfyffw", line 13, in fail
    raise ValueError('no chance, this function crashes so badly')
ValueError: no chance, this function crashes so badly

7ID: 95cf4e22
 Label: test negative score
 Target(s): fail
-0.5 / 1.0
¯\_(ツ)_/¯ partially passed
stdout
stderr
8ID: 511d0ac7
 Label: test import filter
 Target(s): illegal_import
0.5 / 0.5
✅ passed
stdout
stderr
9ID: 53bca0ce
 Label: test global timeout
 Target(s): sleep
0 / 1
❌ TimeoutError: "code execution took longer than 0.100s to terminate"
stdout
stderr
Test failed:
Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_test.py", line 48, in __call__
    result = self._test_function(*targets, *args, **kwargs)
  File "/opt/conda/lib/python3.9/contextlib.py", line 122, in __exit__
    if type is None:
  File "/opt/conda/lib/python3.9/contextlib.py", line 122, in __exit__
    if type is None:
  File "/opt/conda/lib/python3.9/site-packages/autograde/util.py", line 202, in _localtrace
    raise TimeoutError(f'code execution took longer than {timeout:.3f}s to terminate')
TimeoutError: code execution took longer than 0.100s to terminate

10ID: 6d1546e0
 Label: test local timeout
 Target(s): sleep
0 / 1
❌ TimeoutError: "code execution took longer than 0.060s to terminate"
stdout
stderr
Test failed:
Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_test.py", line 48, in __call__
    result = self._test_function(*targets, *args, **kwargs)
  File "/opt/conda/lib/python3.9/contextlib.py", line 122, in __exit__
    if type is None:
  File "/opt/conda/lib/python3.9/contextlib.py", line 122, in __exit__
    if type is None:
  File "/opt/conda/lib/python3.9/site-packages/autograde/util.py", line 202, in _localtrace
    raise TimeoutError(f'code execution took longer than {timeout:.3f}s to terminate')
TimeoutError: code execution took longer than 0.060s to terminate

11ID: ce7ad25b
 Label: inspect source
 Target(s): square
1.0 / 1.0
✅ passed
stdout
def square(x: float) -> float:
    return x ** 2


stderr
12ID: 81b637d8
 Label: Bob
 Target(s): __COMMENTS__
nan / 4
[MATCH 1]: **A1:** The answer, my friend, is blowin' in the wind. The answer is blowin' in the wind.
stdout
stderr
13ID: a0ec927b
 Label: Douglas
 Target(s): __COMMENTS__
nan / 1
[MATCH 1]: **A2:** 42 (forty-two)
stdout
stderr
14ID: a03b221c
 Label: ???
 Target(s): __COMMENTS__
0 / 2.5
❌ AssertionError: "no matching comments found"
stdout
stderr
Test failed:
Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_test.py", line 48, in __call__
    result = self._test_function(*targets, *args, **kwargs)
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_test.py", line 140, in search_comment
    assert len(comments) > 0, 'no matching comments found'
AssertionError: no matching comments found

15ID: f81f7128
 Label: plot PNG
 Target(s): __ARTIFACTS__
nan / 1['__ARTIFACTS__']
stdout
stderr
16ID: affcf4c8
 Label: file not found
 Target(s): __ARTIFACTS__
0 / 1
❌ FileNotFoundError: "[Errno 2] No such file or directory: 'artifacts/does_not_exist.png'"
stdout
stderr
Test failed:
Traceback (most recent call last):
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_test.py", line 48, in __call__
    result = self._test_function(*targets, *args, **kwargs)
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_test.py", line 174, in load_plot
    return math.nan, prefix + base64.b64encode(artifacts[target]).decode('utf8')
  File "/opt/conda/lib/python3.9/site-packages/autograde/notebook_executor.py", line 39, in __getitem__
    with self._root.joinpath(path).open(mode='rb') as f:
  File "/opt/conda/lib/python3.9/pathlib.py", line 1242, in open
    return io.open(self, mode, buffering, encoding, errors, newline,
  File "/opt/conda/lib/python3.9/pathlib.py", line 1110, in _opener
    return self._accessor.open(self, flags, mode)
FileNotFoundError: [Errno 2] No such file or directory: 'artifacts/does_not_exist.png'

17ID: d376512f
 Label: raw artifact
 Target(s): __ARTIFACTS__
1.0 / 1.0
the following was read from a file: "let's leave some artifacts in the system"
stdout
stderr
18ID: a814e911
 Label: special variables
 Target(s): __CONTEXT__,__TEAM_MEMBERS__,__COMMENTS__
1.0 / 1.0
✅ passed
stdout
Hello Alice
Hello Bob

the tested notebook has 20 comments

stderr
18nan / 27.07 passed, 6 failed, 3 pending
Group Members
Last NameFirst NameID
FooAlice12345
BarBob54321
NOTE: If you appear in multiple assignments we reserve the right to take the lower grading!
Log
All test results are based on the Jupyter notebook with checksum: 598b9a96.
TitleTimestampModifications
demo notebook test2021-11-10 13:23:06
Artifacts
The following files have been created or modified during execution of the Jupyter notebook:
  • bar.txt
  • figures/fig_cell_4_clean_1.png
  • figures/fig_cell_9_1.png
  • figures/fig_cell_9_2.png
  • fnord.txt
  • plot.png
All files listed above can be found in the /artifacts directory of the results archive.
The following files have been excluded from the results archive as they haven't changed during execution:
  • foo.txt