o ib@sddlmZddlmZddlmZddlZddlmZddl m Z m Z m Z m Z mZmZmZddlmZmZmZdd lmZdd lmZmZdd lmZmZd d lmZmZm Z m!Z!m"Z"m#Z#ddl$m%Z%m&Z&ddl'm(Z(m)Z)ddl*m+Z+m,Z,ddl-m.Z.ddl/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6ddl7m8Z8ddgZ9GdddeZ:GdddeZ;GdddZGd!d"d"Z?dS)#) annotations)Optional)LiteralN)_legacy_response)BodyOmitQueryHeadersNotGivenomit not_given) path_templatemaybe_transformasync_maybe_transform)cached_property)SyncAPIResourceAsyncAPIResource)to_streamed_response_wrapper"async_to_streamed_response_wrapper) OutputItemsAsyncOutputItemsOutputItemsWithRawResponseAsyncOutputItemsWithRawResponse OutputItemsWithStreamingResponse%AsyncOutputItemsWithStreamingResponse)SyncCursorPageAsyncCursorPage)run_list_paramsrun_create_params)AsyncPaginatormake_request_options)Metadata)RunListResponse)RunCancelResponse)RunCreateResponse)RunDeleteResponse)RunRetrieveResponseRuns AsyncRunsc @eZdZdZed7ddZed8ddZed9d d Zeed d d e d d:dd Z d d d e d!d;d$d%Z eeeed d d e d&dd5d6Zd S)?r),Manage and run evals in the OpenAI platform.returnrcC t|jSr,)r_clientselfr3Z/home/kim/smarthome/.venv/lib/python3.10/site-packages/openai/resources/evals/runs/runs.py output_items( zRuns.output_itemsRunsWithRawResponsecCt|Sa This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content. For more information, see https://www.github.com/openai/openai-python#accessing-raw-response-data-eg-headers )r7r1r3r3r4with_raw_response-zRuns.with_raw_responseRunsWithStreamingResponsecCr8z An alternative to `.with_raw_response` that doesn't eagerly read the response body. For more information, see https://www.github.com/openai/openai-python#with_streaming_response )r<r1r3r3r4with_streaming_response7zRuns.with_streaming_responseNmetadataname extra_headers extra_query extra_bodytimeouteval_idstr data_sourcerun_create_params.DataSourcerAOptional[Metadata] | OmitrB str | OmitrCHeaders | NonerD Query | NonerE Body | NonerF'float | httpx.Timeout | None | NotGivenr&c CsH|s td||jtd|dt|||dtjt||||dtdS)  Kicks off a new run for a given evaluation, specifying the data source, and what model configuration to use to test. The datasource will be validated against the schema specified in the config of the evaluation. Args: data_source: Details about the run's data source. metadata: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters. name: The name of the run. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds 6Expected a non-empty value for `eval_id` but received /evals/{eval_id}/runsrGrIrArBrCrDrErFbodyoptionscast_to) ValueError_postrrr RunCreateParamsr"r& r2rGrIrArBrCrDrErFr3r3r4create@s ' z Runs.createrVrun_idr(cCJ|s td||std||jtd||dt||||dtdS)P Get an evaluation run by ID. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rR5Expected a non-empty value for `run_id` but received /evals/{eval_id}/runs/{run_id}rGr`rVrYrZr[_getrr"r(r2r`rGrCrDrErFr3r3r4retrievey z Runs.retrieveafterlimitorderstatusrCrDrErFrmrn int | OmitroLiteral['asc', 'desc'] | OmitrpJLiteral['queued', 'in_progress', 'completed', 'canceled', 'failed'] | OmitSyncCursorPage[RunListResponse]c CP|s td||jtd|dttt|||| t||||dtjdtdSa Get a list of runs for an evaluation. Args: after: Identifier for the last run from the previous pagination request. limit: Number of runs to retrieve. order: Sort order for runs by timestamp. Use `asc` for ascending order or `desc` for descending order. Defaults to `asc`. status: Filter runs by status. One of `queued` | `in_progress` | `failed` | `completed` | `canceled`. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rRrSrT)rmrnrorp)rCrDrErFquery)pagerYmodel) r[ _get_api_listrrr$r"rr RunListParams r2rGrmrnrorprCrDrErFr3r3r4list*% z Runs.listr'cCra)G Delete an eval run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rRrcrdrerVrfr[_deleterr"r'rir3r3r4deleterkz Runs.deleter%cCra)U Cancel an ongoing evaluation run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rRrcrdrerVrfr[r\rr"r%rir3r3r4cancelrkz Runs.cancel)r-r)r-r7)r-r<rGrHrIrJrArKrBrLrCrMrDrNrErOrFrPr-r&r`rHrGrHrCrMrDrNrErOrFrPr-r()rGrHrmrLrnrqrorrrprsrCrMrDrNrErOrFrPr-rtr`rHrGrHrCrMrDrNrErOrFrPr-r'r`rHrGrHrCrMrDrNrErOrFrPr-r%__name__ __module__ __qualname____doc__rr5r:r>r r r_rjr}rrr3r3r3r4r)%N    @(C+c @r+)?r*r,r-rcCr.r/)rr0r1r3r3r4r5%r6zAsyncRuns.output_itemsAsyncRunsWithRawResponsecCr8r9)rr1r3r3r4r:*r;zAsyncRuns.with_raw_responseAsyncRunsWithStreamingResponsecCr8r=)rr1r3r3r4r>4r?z!AsyncRuns.with_streaming_responseNr@rGrHrIrJrArKrBrLrCrMrDrNrErOrFrPr&c sV|s td||jtd|dt|||dtjIdHt||||dtdIdHS)rQrRrSrTrUNrVrW)r[r\rrr r]r"r&r^r3r3r4r_=s"'  zAsyncRuns.createrVr`r(cR|s td||std||jtd||dt||||dtdIdHS)rbrRrcrdrerVrfNrgrir3r3r4rjv  zAsyncRuns.retrieverlrmrnrqrorrrprsAAsyncPaginator[RunListResponse, AsyncCursorPage[RunListResponse]]c Crurv) r[rzrrr$r"rrr{r|r3r3r4r}r~zAsyncRuns.listr'cr)rrRrcrdrerVrfNrrir3r3r4rrzAsyncRuns.deleter%cr)rrRrcrdrerVrfNrrir3r3r4rrzAsyncRuns.cancel)r-r)r-r)r-rrr)rGrHrmrLrnrqrorrrprsrCrMrDrNrErOrFrPr-rrrrr3r3r3r4r*"rc@$eZdZd ddZed dd Zd S) r7runsr)r-NonecCP||_t|j|_t|j|_t|j|_t|j|_t|j|_dSN)_runsrZto_raw_response_wrapperr_rjr}rrr2rr3r3r4__init__   zRunsWithRawResponse.__init__rcC t|jjSr/)rrr5r1r3r3r4r53 z RunsWithRawResponse.output_itemsNrr)r-r)r-rrrrrrr5r3r3r3r4r7 r7c@r) rrr*r-rcCrr)rrZasync_to_raw_response_wrapperr_rjr}rrrr3r3r4r:rz!AsyncRunsWithRawResponse.__init__rcCrr/)rrr5r1r3r3r4r5Mrz%AsyncRunsWithRawResponse.output_itemsNrr*r-r)r-rrr3r3r3r4r9rrc@r) r<rr)r-rcCF||_t|j|_t|j|_t|j|_t|j|_t|j|_dSr)rrr_rjr}rrrr3r3r4rT  z"RunsWithStreamingResponse.__init__rcCrr/)rrr5r1r3r3r4r5grz&RunsWithStreamingResponse.output_itemsNr)r-rrr3r3r3r4r<Srr<c@r) rrr*r-rcCrr)rrr_rjr}rrrr3r3r4rnrz'AsyncRunsWithStreamingResponse.__init__rcCrr/)rrr5r1r3r3r4r5rz+AsyncRunsWithStreamingResponse.output_itemsNr)r-rrr3r3r3r4rmrr)@ __future__rtypingrZtyping_extensionsrZhttpxr_typesrrr r r r r Z_utilsrrrZ_compatrZ _resourcerr _responserrr5rrrrrrZ paginationrrZ types.evalsrr Z _base_clientr!r"Ztypes.shared_params.metadatar#Ztypes.evals.run_list_responser$Ztypes.evals.run_cancel_responser%Ztypes.evals.run_create_responser&Ztypes.evals.run_delete_responser'Z!types.evals.run_retrieve_responser(__all__r)r*r7rr<rr3r3r3r4s:    $        ~~