add cs350 winter 2019 midterm#89
Draft
qimcis wants to merge 189 commits intosys-intelligence:mainfrom
Draft
Conversation
…stinguish-api-keys Distinguish the models used in the executor and evaluator
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
…s/sysmobench/sysmobench_core'
- Add gpt-4o model configuration to models.yaml - Fix setup_tools.py to use shutil.move instead of os.rename This resolves 'Invalid cross-device link' error when /tmp is on different filesystem
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
* modified the regular expression match * added cs107_fall_2023_final * updated one wrong tag * Added pdf of the paper * solved all the comments
* Add UIUC CS423 Fall 2025 Exams * Fix json parsing * Fix backtick * Fix backtick 2 * Update benchmarks/courseexam_bench/data/cs_423_operating_systems_design_fall_2025_midterm/MP1.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * Update benchmarks/courseexam_bench/data/cs_423_operating_systems_design_fall_2025_final/exam.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Xuan Feng <xfeng9209@gmail.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
…ce#54) * add ostep processes-shell lab * fix * Update benchmarks/courselab_bench/data/cs537-projects-spring-2019/processes_shell/task.md Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> --------- Co-authored-by: Tarek Elsayed <60650661+tareknaser@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
* added cmu15-213 data lab * docs(courselab): add note about infrastructure restrictions Signed-off-by: Tarek <tareknaser360@gmail.com> --------- Signed-off-by: Tarek <tareknaser360@gmail.com> Co-authored-by: Tarek <tareknaser360@gmail.com>
* add cs537 fall 2021 final exam * add institution * fix * add solutions * update metadata * add choice array * avoid extra restrictions on LLM output Signed-off-by: Tarek <tareknaser360@gmail.com> --------- Signed-off-by: Tarek <tareknaser360@gmail.com> Co-authored-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
Signed-off-by: Tarek <tareknaser360@gmail.com>
777lefty
reviewed
Jan 22, 2026
Collaborator
777lefty
left a comment
777lefty
left a comment
There was a problem hiding this comment.
format and missing issue, besides, the structure of this exam and the problem-metadata mapping is not clear
| "llm_judge_instructions": "Award 2 points for stating that (ii) is faster and giving a correct reason (e.g., fewer syscalls or less I/O overhead). Award 0 points otherwise." | ||
| } | ||
| ``` | ||
| --- |
Collaborator
There was a problem hiding this comment.
Correct me if I am wrong: isn't --- supposed to be used for separating problems (that started with ## Question x)?
@tareknaser
| } | ||
| ``` | ||
| --- | ||
| b. (2 marks) Concurrency |
Collaborator
There was a problem hiding this comment.
If we are regarding each subproblem as an individual question with metadata here, perhaps we should use ## Question x to indicate
|
|
||
| ```json | ||
| { | ||
| "problem_id": "4", |
Collaborator
There was a problem hiding this comment.
from here on the problem_id in metadata can't match Question x
| "answer": "Actions not prevented by either condition include voluntary thread exit (threadexit), explicit yield (threadyield), and thread blocking/sleep.", | ||
| "llm_judge_instructions": "Award 2 points for listing the three items (thread exit, thread yield, thread block/sleep) or equivalent. Award 1 point for listing two correct items. Award 0 points otherwise." | ||
| } | ||
| ``` |
Collaborator
There was a problem hiding this comment.
Chaotic metadata-subproblem mapping here
| --- | ||
| ## Question 4 [10 marks] | ||
|
|
||
| The following pseudocode makes use of a semaphore. Replace the semaphore-based implementation with a condition-variable-based implementation that performs the same task. You may only add up to three additional variables. Your cv may not be used with a loop. |
| Lock = CLOSED; | ||
| CriticalSection(); | ||
| Lock = OPEN; | ||
| } |
| while (Last == 2){;} | ||
| CriticalSection(); | ||
| Last = 2; | ||
| } |
| ``` | ||
| --- | ||
| b. (2 marks) | ||
|
|
Collaborator
There was a problem hiding this comment.
problem description and instruction missed here
| CriticalSection(); | ||
| T2 = !WANT_IN; | ||
| } | ||
|
|
| Last = 2; | ||
| T2 = !WANT_IN; | ||
| } | ||
|
|
qimcis
force-pushed
the
cs350-winter-2019-midterm
branch
from
55ff1ea to
6fc810d
Compare
qimcis
force-pushed
the
cs350-winter-2019-midterm
branch
from
6fc810d to
7beee15
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
9 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add the CS 350 Winter 2019 Midterm exam dataset and associated solution to the repository.
Changes
Testing
Prepared the dataset and validated processing by running: python3 courseexam/prepare.py without errors.
Checklist