-
Notifications
You must be signed in to change notification settings - Fork 149
Open
Description
Please provide us with the following information:
This issue is for a: (mark with an x)
- [ ] bug report -> please search issues before submitting
- [ ] feature request
- [ ] documentation issue or request
- [ ] regression (a behavior that used to work and stopped in a new release)
Minimal steps to reproduce
I am trying to hook up the evaluate method with my own prompt which used to run from pf_client.run
example code below:
from promptflow.client import PFClient
pf_client = PFClient()
def user_call():
my_prompt_flow = pf_client.run(my prompt flow configs)
return my_prompt_flow_output
def run_evaluation():
results = evaluate(
evaluation_name=evaluation_name,
data=data_path,
target=user_call,
evaluators={
"violence": violence_evaluator,
"sexual": sex_evaluator,
"self_harm": self_harm_evaluator,
"hate_unfairnes": hate_unfairness_evaluator,
"content_safety": content_safety_evaluator
},
azure_ai_project=project_scope
)
Any log messages given by the failure
2024-07-06 00:58:41 +0000 1845174 execution.bulk INFO The process [1845174] has received a terminate signal.
2024-07-06 00:58:42 +0000 1844849 execution ERROR 1/1 flow run failed, indexes: [0], exception of index 0: Execution failure in 'user_call': (UnexpectedError) Unexpected error occurred while executing the batch run. Error: (AssertionError) daemonic processes are not allowed to have children.
Expected/desired behavior
OS and Version?
Windows 7, 8 or 10. Linux (which distribution). macOS (Yosemite? El Capitan? Sierra?)
Linux
Versions
Mention any other details that might be useful
Thanks! We'll be in touch soon.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels