Job maker objects
Objects and models for hila Enterprise jobs, including dataloading, deployments, model performance, preprocessing, etc. See supported Job maker APIs.
vianops_client.models.jobmaker.dataloading
- pydantic model V1DataloadingJob
Bases:
BaseModelShow JSON schema
{ "title": "V1DataloadingJob", "type": "object", "properties": { "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "Data description.", "title": "Description" }, "dryrun": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "Dry run determines if data is NOT to be saved in a table. Default value is `False` and data is saved.", "title": "Dryrun" }, "dtypes": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "A list of pandas data types as a string instance.", "title": "Dtypes" }, "filetype": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "parquet", "description": "File type containing data to be loaded. Acceptable values include: `csv`, 'json`, and 'paquet`. Parquet file types are recommended over json or csv files. Default value is `parquet`.", "title": "Filetype" }, "overwrite": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "Replace", "description": "Determines how to manage data if already exists. Supported values: `replace` (overwrite existing data) and `append` (add new data to existing data).", "title": "Overwrite" }, "separator": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": ",", "description": "Data separator.", "title": "Separator" }, "setname": { "description": "Feature set name.", "title": "Setname", "type": "string" }, "tablename": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Table name.", "title": "Tablename" }, "srcurl": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Source url fron where data is to be loaded.", "title": "Srcurl" }, "upload_key": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Cache upload key.", "title": "Upload Key" }, "job_description": { "anyOf": [ { "type": "string" }, { "type": "object" }, { "type": "null" } ], "default": null, "description": "Job description.", "title": "Job Description" }, "job_type": { "const": "dataloading", "default": "dataloading", "description": "Job type. Supports one value: dataloading (the default value).", "title": "Job Type", "type": "string" }, "maintain_archives": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "If `true` creates an archive table of a snapshot of the data before it is overwritten or appended; otherwise, `false` (the default value).", "title": "Maintain Archives" }, "connectionname": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "Internal clickhouse DB", "description": "Connection name must match one of the connections already in data source connection list.", "title": "Connectionname" }, "tabs": { "anyOf": [ { "items": { "$ref": "#/$defs/V1TableDetails" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "tabs containing sheet information of workbook", "title": "Tabs" }, "engine": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Engine clause appended to CREATE TABLE for some databases if supplied ie 'ENGINE = MergeTree order by (columname)' .", "title": "Engine" }, "table_structure_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "cf3_3_0_r_1_table_structure", "description": "the name of the table structure/schema.", "title": "Table Structure Name" }, "enforce_table_structure": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "If `true` enforces the table structure/schema; otherwise, `false` (the default value).", "title": "Enforce Table Structure" } }, "$defs": { "V1TableDetails": { "properties": { "tabname": { "default": null, "description": "sheet name in workbook", "title": "Tabname", "type": "string" }, "columns": { "default": null, "description": "List of colmunname", "items": { "type": "string" }, "title": "Columns", "type": "array" } }, "title": "V1TableDetails", "type": "object" } }, "required": [ "setname" ] }
- Fields:
- Validators:
- field connectionname: str | None = 'Internal clickhouse DB'
Connection name must match one of the connections already in data source connection list.
- field description: str | None = 'Data description.'
- field dryrun: bool | None = False
Dry run determines if data is NOT to be saved in a table. Default value is False and data is saved.
- field dtypes: str | None = None
A list of pandas data types as a string instance.
- field enforce_table_structure: bool | None = False
If true enforces the table structure/schema; otherwise, false (the default value).
- field engine: str | None = None
Engine clause appended to CREATE TABLE for some databases if supplied ie ‘ENGINE = MergeTree order by (columname)’ .
- field filetype: str | None = 'parquet'
File type containing data to be loaded. Acceptable values include: csv, ‘json`, and ‘paquet`. Parquet file types are recommended over json or csv files. Default value is parquet.
- Validated by:
- field job_description: str | dict | None = None
Job description.
- field job_type: Literal['dataloading'] = 'dataloading'
Job type. Supports one value: dataloading (the default value).
- field maintain_archives: bool | None = False
If true creates an archive table of a snapshot of the data before it is overwritten or appended; otherwise, false (the default value).
- field overwrite: str | None = 'Replace'
Determines how to manage data if already exists. Supported values: replace (overwrite existing data) and append (add new data to existing data).
- field separator: str | None = ','
Data separator.
- field setname: str [Required]
Feature set name.
- Validated by:
- field srcurl: str | None = None
Source url fron where data is to be loaded.
- field table_structure_name: str | None = 'cf3_3_0_r_1_table_structure'
the name of the table structure/schema.
- field tablename: str | None = None
Table name.
- field tabs: List[V1TableDetails] | None = None
tabs containing sheet information of workbook
- field upload_key: str | None = None
Cache upload key.
vianops_client.models.jobmaker.deployment_mgt
- pydantic model V1CreateDeploymentModel
Bases:
BaseModelShow JSON schema
{ "title": "V1CreateDeploymentModel", "type": "object", "properties": { "model_name": { "description": "The name of the model.", "title": "Model Name", "type": "string" }, "deployment_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the deployment.", "title": "Deployment Name" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The version of the model, e.g., 1.", "title": "Model Version" }, "model_path": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Path (location) for the model to deploy.", "title": "Model Path" }, "model_run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Run id for the model to deploy.", "title": "Model Run Id" } }, "example": { "deployment_name": "deployment_xyz", "model_name": "vianai.model_name", "model_path": "", "model_run_id": "abcdef-123456-xyzyui", "model_version": "1" }, "required": [ "model_name" ] }
- Config:
protected_namespaces: tuple = ()
json_schema_extra: dict = {‘example’: {‘deployment_name’: ‘deployment_xyz’, ‘model_name’: ‘vianai.model_name’, ‘model_version’: ‘1’, ‘model_path’: ‘’, ‘model_run_id’: ‘abcdef-123456-xyzyui’}}
- Fields:
- field deployment_name: str | None = None
The name of the deployment.
- field model_name: str [Required]
The name of the model.
- field model_path: str | None = None
Path (location) for the model to deploy.
- field model_run_id: str | None = None
Run id for the model to deploy.
- field model_version: str | None = None
The version of the model, e.g., 1.
- pydantic model V1DeploymentModel
Bases:
BaseModelShow JSON schema
{ "title": "V1DeploymentModel", "type": "object", "properties": { "deployment_detail": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "title": "Deployment Detail" }, "config": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "title": "Config" }, "name": { "title": "Name", "type": "string" }, "deployment_name": { "title": "Deployment Name", "type": "string" }, "user_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "User Id" }, "run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Run Id" }, "job_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Job Type" }, "models": { "anyOf": [ { "items": { "$ref": "#/$defs/V1ModelModel" }, "type": "array" }, { "type": "null" } ], "default": [], "title": "Models" }, "model_name": { "title": "Model Name", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Version" }, "model_path": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Path" }, "model_uri": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Uri" }, "status": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Status" }, "status_msg": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Status Msg" }, "timestamp": { "anyOf": [ { "type": "number" }, { "type": "null" } ], "default": null, "title": "Timestamp" } }, "$defs": { "V1ModelModel": { "properties": { "model_name": { "title": "Model Name", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Version" }, "model_path": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Path" }, "model_uri": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Uri" }, "deployment_mode": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Mode" }, "run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Run Id" } }, "required": [ "model_name" ], "title": "V1ModelModel", "type": "object" } }, "required": [ "name", "deployment_name", "model_name" ] }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field config: dict | None = None
- field deployment_detail: dict | None = None
- field deployment_name: str [Required]
- field job_type: str | None = None
- field model_name: str [Required]
- field model_path: str | None = None
- field model_uri: str | None = None
- field model_version: str | None = None
- field models: List[V1ModelModel] | None = []
- field name: str [Required]
- field run_id: str | None = None
- field status: str | None = None
- field status_msg: str | None = None
- field timestamp: float | None = None
- field user_id: str | None = None
- pydantic model V1ModelModel
Bases:
BaseModelShow JSON schema
{ "title": "V1ModelModel", "type": "object", "properties": { "model_name": { "title": "Model Name", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Version" }, "model_path": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Path" }, "model_uri": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Model Uri" }, "deployment_mode": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Mode" }, "run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Run Id" } }, "required": [ "model_name" ] }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field deployment_mode: str | None = None
- field model_name: str [Required]
- field model_path: str | None = None
- field model_uri: str | None = None
- field model_version: str | None = None
- field run_id: str | None = None
- pydantic model V1PlaceholderDeploymentResponse
Bases:
BaseModelShow JSON schema
{ "title": "V1PlaceholderDeploymentResponse", "type": "object", "properties": { "user_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "User Id" }, "version_comment": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Version Comment" }, "deployment_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Version" }, "deployment_status": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Status" }, "deployment_mode": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Mode" }, "deployment_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Name" }, "deployment_kind": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Kind" }, "deployment_yaml": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Deployment Yaml" }, "deployment_detail": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "title": "Deployment Detail" }, "model_details": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": [], "title": "Model Details" }, "status": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Status" }, "timestamp": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Timestamp" }, "internal_endpointurl": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Internal Endpointurl" }, "external_endpointurl": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "External Endpointurl" } } }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field deployment_detail: dict | None = None
- field deployment_kind: str | None = None
- field deployment_mode: str | None = None
- field deployment_name: str | None = None
- field deployment_status: str | None = None
- field deployment_version: str | None = None
- field deployment_yaml: str | None = None
- field external_endpointurl: str | None = None
- field internal_endpointurl: str | None = None
- field model_details: List[dict] | None = []
- field status: str | None = None
- field timestamp: str | None = None
- field user_id: str | None = None
- field version_comment: str | None = None
vianops_client.models.jobmaker.driftdetection
- pydantic model V1DriftDetectionJob
Bases:
BaseModelShow JSON schema
{ "title": "V1DriftDetectionJob", "description": "Description of Policy", "type": "drift", "properties": { "deployment": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the deployment.", "title": "Deployment" }, "model_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the model.", "title": "Model Name" }, "job_type": { "const": "driftdetection", "default": "driftdetection", "description": "Drift detection type.", "title": "Job Type", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The version of the model, e.g., 1.", "title": "Model Version" }, "model_stage": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The stage of the model, e.g., primary.", "title": "Model Stage" }, "name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the policy.", "title": "Name" }, "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Parameters passed to the drift detection job.", "title": "Description" }, "type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The type of policy.", "title": "Type" }, "policy": { "$ref": "#/$defs/V1DriftPolicy", "description": "drift policy for detection" }, "drift_policies": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "Extending support for legacy drift policies.", "title": "Drift Policies" }, "status": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "active", "description": "The status of policy, such as `active` or `inactive`.", "title": "Status" }, "segments": { "description": "List of segments in drift detection policies.", "items": { "$ref": "#/$defs/V1SegmentModel" }, "title": "Segments", "type": "array" }, "uuid": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "UUID for the drift policy", "title": "Uuid" }, "created_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the drift policy is created. You can specify the timestamp as a float or date time string value.", "title": "Created Ts" }, "modified_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the drift policy is modified. You can specify the timestamp as a float or date time string value.", "title": "Modified Ts" }, "created_by": { "description": "User who created the segment.", "title": "Created By", "type": "string" }, "modified_by": { "description": "User who last modified the segment.", "title": "Modified By", "type": "string" } }, "$defs": { "V1Baseline": { "properties": { "window_method": { "description": "The window method. Supported values: `prior`, `last`, `same_prior_year`, `training` .", "title": "Window Method", "type": "string" }, "window_type": { "description": "The baseline window type. Supported values: `day`, `week`, `month`, `quarter`, `year`, `training`.", "title": "Window Type", "type": "string" }, "last_amount": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The last amount of `prior` or `last` for the given window type.", "title": "Last Amount" }, "process_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The process date.", "title": "Process Date" }, "offset_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The policy`s offset type. Supported values: `week`, `month`, and `quarter`.", "title": "Offset Type" }, "offset": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The offset amount.", "title": "Offset" }, "start_of_week": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The start day of week. Supported values: `monday`, `tuesday`, `wednesday`, `thursday`, `friday`, `saturday`, `sunday`.", "title": "Start Of Week" }, "quarter_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the quarter.", "title": "Quarter Start" }, "year_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the year.", "title": "Year Start" } }, "required": [ "window_method", "window_type" ], "title": "V1Baseline", "type": "object" }, "V1BetweenOperatorModel": { "properties": { "min": { "default": null, "description": "Minimum value of BETWEEN.", "title": "Min", "type": "number" }, "max": { "default": null, "description": "Maximum value of BETWEEN.", "title": "Max", "type": "number" } }, "title": "V1BetweenOperatorModel", "type": "object" }, "V1DriftPolicy": { "example": { "critical_level": 0.25, "deployment_name": "d_mp_placeholder_deployment", "hotspot": { "features": [ "a", "b", "c" ], "method": "flat", "value": 50 }, "method": "preprocess", "schedule": "0 0 5 ? * *", "warning_level": 0.1, "window_parameters": { "baseline": { "last_amount": 2, "window_method": "last", "window_type": "week" }, "target": { "window_type": "week" } } }, "properties": { "window_parameters": { "$ref": "#/$defs/V1WindowParameters", "description": "The window parameters, which include the target and baseline parameters." }, "warning_level": { "anyOf": [ { "type": "number" }, { "type": "integer" } ], "description": "The warning level value. For distance based drift and performance drift, the expected value type is a float. For window based drift, the expected value type is an integer.", "title": "Warning Level" }, "critical_level": { "anyOf": [ { "type": "number" }, { "type": "integer" } ], "description": "The critical level value. For distance based drift and performance drift, the expected value type is a float. For window based drift, the expected value type is an integer.", "title": "Critical Level" }, "schedule": { "description": "The cron scheduleer.", "title": "Schedule", "type": "string" }, "deployment_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the deployment the policy belongs to.", "title": "Deployment Name" }, "method": { "description": "The drift method.", "title": "Method", "type": "string" }, "hotspot_analysis": { "anyOf": [ { "$ref": "#/$defs/V1HotspotParamsModel" }, { "type": "null" } ], "default": { "method": "percent", "value": 100, "features": [] }, "description": "Parameters that determine the features to run hotspot analysis against and level of traffic to include." }, "type": { "description": "The drift category. Supported values: `feature-drift`, `prediction-drift`.", "title": "Type", "type": "string" }, "drift_type": { "description": "The type of drift. Supported values: `distance`, `windowed`.", "title": "Drift Type", "type": "string" }, "select_features_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The features to be included in drift policy. Supported values: `custom`, `all`.", "title": "Select Features Type" }, "feature_weightage": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The weight category selected for the included features. Supported values: `equal`, `manual`.", "title": "Feature Weightage" }, "feature_weights": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "The specific weight given to each feature.", "title": "Feature Weights" }, "drift_measure": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The drift measure. Supported values: `PSI`, `JS`.", "title": "Drift Measure" }, "baseline_bins": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "The custom bin dictionary for which to run drift against per feature.", "title": "Baseline Bins" } }, "required": [ "window_parameters", "warning_level", "critical_level", "schedule", "method", "type", "drift_type" ], "title": "V1DriftPolicy", "type": "object" }, "V1HotspotParamsModel": { "example": { "hotspot": { "features": [ "a", "b", "c" ], "method": "flat", "value": 50 } }, "properties": { "method": { "description": "Method for selecting top hotspot results. Currently supported values: `flat` (straight number limit) and `percent` (top value % of the hotspots results).", "enum": [ "flat", "percent" ], "title": "Method", "type": "string" }, "value": { "description": "Integer value that correlates to the selected method. If using percent as the selected method, number can never be greater than 100.", "title": "Value", "type": "integer" }, "features": { "description": "List of hotspot features (of categorical data type) to be used when performing hotspot analysis.", "items": { "type": "string" }, "title": "Features", "type": "array" } }, "required": [ "method", "value", "features" ], "title": "V1HotspotParamsModel", "type": "object" }, "V1SegmentFilterModel": { "additionalProperties": false, "example": { "conjunction": "AND", "feature_name": "FEATURE NAME", "grouped_filters": [ { "conjunction": "AND", "feature_name": "FEATURE NAME", "operator": "=", "value": [ "VALUE 1", "VALUE 2" ] } ], "operator": "=", "value": [ "VALUE 1", "VALUE 2" ] }, "properties": { "feature_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of feature field to do the operation on.", "title": "Feature Name" }, "value": { "anyOf": [ { "items": { "anyOf": [ { "type": "string" }, { "type": "integer" }, { "type": "boolean" }, { "type": "number" } ] }, "type": "array" }, { "type": "string" }, { "type": "integer" }, { "type": "boolean" }, { "type": "number" }, { "$ref": "#/$defs/V1BetweenOperatorModel" }, { "$ref": "#/$defs/V1TopBottomOperatorModel" }, { "type": "null" } ], "default": null, "description": "Values of operator doing the filter. Value types supported are based on operator.", "title": "Value" }, "operator": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Operation to perform on the feature field. This field is case-insensitive. Supported operators: `=`, `>`, `<`, `<=`, `>=`, `BETWEEN`, `TOP`, `BOTTOM`, `DISTINCT`", "title": "Operator" }, "conjunction": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Relationship to next filter. If there is no next filter, set to null. This field is case-insensitive. Supported values: `AND`, `OR`, `null`. Default value is `null`.", "title": "Conjunction" }, "grouped_filters": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of grouped filters. Use for creating a nested filter within a filter.", "title": "Grouped Filters" } }, "title": "V1SegmentFilterModel", "type": "object" }, "V1SegmentModel": { "example": { "created_by": "user1", "created_ts": 1672531200000, "description": "DESCRIPTION", "filters": [ { "conjunction": null, "feature_name": "FEATURE NAME", "grouped_filters": null, "operator": "=", "value": [ "VALUE 1", "VALUE 2" ] } ], "id": 1, "model_uuid": "5efc9544-e84a-4a94-9e6d-5774e1c609ab", "modified_by": "user2", "modified_ts": 1672531200000, "name": "NAME", "status": "inactive" }, "properties": { "model_uuid": { "description": "Unique identifier for model.", "title": "Model Uuid", "type": "string" }, "name": { "description": "Name of the segment.", "title": "Name", "type": "string" }, "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Description of the segment.", "title": "Description" }, "filters": { "description": "List of segment filters, their conditions, and relationships.", "items": { "$ref": "#/$defs/V1SegmentFilterModel" }, "title": "Filters", "type": "array" }, "id": { "description": "Unique identifier generated by the platform for the segment.", "title": "Id", "type": "integer" }, "status": { "description": "Current status of the segment. This field is case-insensitive. Possible values: `active`, `inactive` (default), `archived`, `delete`.", "title": "Status", "type": "string" }, "created_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the segment is created. You can specify the timestamp as a float or date time string value.", "title": "Created Ts" }, "modified_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the segment is modified. You can specify the timestamp as a float or date time string value.", "title": "Modified Ts" }, "created_by": { "description": "User who created the segment.", "title": "Created By", "type": "string" }, "modified_by": { "description": "User who last modified the segment.", "title": "Modified By", "type": "string" } }, "required": [ "model_uuid", "name", "filters", "id", "status", "created_ts", "modified_ts", "created_by", "modified_by" ], "title": "V1SegmentModel", "type": "object" }, "V1Target": { "properties": { "window_type": { "description": "The target window type. Accepted values include: `day`, `week`, `month`, `quarter`, and `year`.", "title": "Window Type", "type": "string" }, "process_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The process date.", "title": "Process Date" }, "offset_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The policy`s offset type. Accepted values include: `week`, `month`, and `quarter`.", "title": "Offset Type" }, "offset": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The offset amount.", "title": "Offset" }, "start_of_week": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The start day of week. Supported values: `monday`, `tuesday`, `wednesday`, `thursday`, `friday`, `saturday`, `sunday`.", "title": "Start Of Week" }, "quarter_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the quarter.", "title": "Quarter Start" }, "year_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the year.", "title": "Year Start" } }, "required": [ "window_type" ], "title": "V1Target", "type": "object" }, "V1TopBottomOperatorModel": { "properties": { "direction": { "default": "DESC", "description": "Direction of field values. This field is case-insensitive. Supported directions: `ASC` (ascending), `DESC` (descending). Default is `DESC`.", "title": "Direction", "type": "string" }, "method": { "default": "flat", "description": "Whether it should be the top/bottom percent or flat amount. This field is case-insensitive. Supported methods: `percent`, `flat`. Default is `flat`.", "title": "Method", "type": "string" }, "value": { "default": null, "description": "Percent or flat number of rows to take.", "title": "Value", "type": "number" } }, "title": "V1TopBottomOperatorModel", "type": "object" }, "V1WindowParameters": { "properties": { "target": { "$ref": "#/$defs/V1Target", "description": "The target parameters." }, "baseline": { "$ref": "#/$defs/V1Baseline", "description": "The baseline parameters." } }, "required": [ "target", "baseline" ], "title": "V1WindowParameters", "type": "object" } }, "created_by": "vianai", "created_ts": 1679496214659.72, "deployment": "vianai.d_mp_placeholder_deployment", "job_type": "driftdetection", "model_name": "vianai.d_mp_placeholder_deployment", "model_stage": "primary", "model_version": "1", "modified_by": "vianai", "modified_ts": 1679496214659.72, "name": "vianai.d_mp_placeholder_deployment.vianai_d_mp_d_mp_placeholder_deployment_1_policy", "policy": { "critical_level": 0.25, "deployment_name": "vianai.d_mp_placeholder_deployment", "drift_measure": "PSI", "drift_type": "distance", "feature_weightage": "equal", "feature_weights": { "est_fare_amount": 25, "extra": 25, "travel_time": 25, "trip_distance": 25 }, "method": "preprocess", "schedule": "0 0 5 ? * *", "select_features_type": "custom", "type": "feature-drift", "warning_level": 0.1, "window_parameters": { "baseline": { "last_amount": 2, "window_method": "last", "window_type": "week" }, "target": { "window_type": "week" } } }, "required": [ "policy", "segments", "created_ts", "modified_ts", "created_by", "modified_by" ], "segments": [ { "created_by": "vianai", "created_ts": 1679496214358.969, "description": "Segment to filter data for particular Pickup and Dropoff locations", "filters": [ { "conjunction": "and", "feature_name": "PULocationID", "grouped_filters": null, "operator": "=", "value": [ "256", "217" ] }, { "conjunction": null, "feature_name": "DOLocationID", "grouped_filters": null, "operator": "=", "value": [ "144", "148" ] } ], "id": 1, "model_uuid": "ff0f98ae-5b59-48dd-8567-14efce48b4b4", "modified_by": "vianai", "modified_ts": 1679496214358.969, "name": "vianai.d_mp_placeholder_deployment_segment_1", "status": "active" } ], "status": "inactive", "uuid": "76ce26d2-a41c-4390-b015-52d7a606aeec" }
- Config:
protected_namespaces: tuple = ()
json_schema_extra: dict = {‘deployment’: ‘vianai.d_mp_placeholder_deployment’, ‘model_name’: ‘vianai.d_mp_placeholder_deployment’, ‘job_type’: ‘driftdetection’, ‘model_version’: ‘1’, ‘model_stage’: ‘primary’, ‘name’: ‘vianai.d_mp_placeholder_deployment.vianai_d_mp_d_mp_placeholder_deployment_1_policy’, ‘description’: ‘Description of Policy’, ‘type’: ‘drift’, ‘policy’: {‘type’: ‘feature-drift’, ‘drift_type’: ‘distance’, ‘window_parameters’: {‘target’: {‘window_type’: ‘week’}, ‘baseline’: {‘window_method’: ‘last’, ‘window_type’: ‘week’, ‘last_amount’: 2}}, ‘select_features_type’: ‘custom’, ‘feature_weightage’: ‘equal’, ‘feature_weights’: {‘trip_distance’: 25, ‘travel_time’: 25, ‘est_fare_amount’: 25, ‘extra’: 25}, ‘drift_measure’: ‘PSI’, ‘warning_level’: 0.1, ‘critical_level’: 0.25, ‘schedule’: ‘0 0 5 ? * *’, ‘deployment_name’: ‘vianai.d_mp_placeholder_deployment’, ‘method’: ‘preprocess’}, ‘status’: ‘inactive’, ‘segments’: [{‘model_uuid’: ‘ff0f98ae-5b59-48dd-8567-14efce48b4b4’, ‘name’: ‘vianai.d_mp_placeholder_deployment_segment_1’, ‘description’: ‘Segment to filter data for particular Pickup and Dropoff locations’, ‘filters’: [{‘feature_name’: ‘PULocationID’, ‘value’: [‘256’, ‘217’], ‘operator’: ‘=’, ‘conjunction’: ‘and’, ‘grouped_filters’: None}, {‘feature_name’: ‘DOLocationID’, ‘value’: [‘144’, ‘148’], ‘operator’: ‘=’, ‘conjunction’: None, ‘grouped_filters’: None}], ‘id’: 1, ‘status’: ‘active’, ‘created_ts’: 1679496214358.969, ‘modified_ts’: 1679496214358.969, ‘created_by’: ‘vianai’, ‘modified_by’: ‘vianai’}], ‘uuid’: ‘76ce26d2-a41c-4390-b015-52d7a606aeec’, ‘created_ts’: 1679496214659.72, ‘modified_ts’: 1679496214659.72, ‘created_by’: ‘vianai’, ‘modified_by’: ‘vianai’}
- Fields:
- field created_by: str [Required]
User who created the segment.
- field created_ts: float | datetime [Required]
Timestamp (Unix time in milliseconds) generated when the drift policy is created. You can specify the timestamp as a float or date time string value.
- field deployment: str | None = None
The name of the deployment.
- field description: str | None = None
Parameters passed to the drift detection job.
- field drift_policies: List[dict] | None = []
Extending support for legacy drift policies.
- field job_type: Literal['driftdetection'] = 'driftdetection'
Drift detection type.
- field model_name: str | None = None
The name of the model.
- field model_stage: str | None = None
The stage of the model, e.g., primary.
- field model_version: str | None = None
The version of the model, e.g., 1.
- field modified_by: str [Required]
User who last modified the segment.
- field modified_ts: float | datetime [Required]
Timestamp (Unix time in milliseconds) generated when the drift policy is modified. You can specify the timestamp as a float or date time string value.
- field name: str | None = None
The name of the policy.
- field policy: V1DriftPolicy [Required]
drift policy for detection
- field segments: List[V1SegmentModel] [Required]
List of segments in drift detection policies.
- field status: str | None = 'active'
The status of policy, such as active or inactive.
- field type: str | None = None
The type of policy.
- field uuid: str | None = None
UUID for the drift policy
vianops_client.models.jobmaker.job
- pydantic model V1BenchmarkOptimizeRequest
Bases:
BaseModelShow JSON schema
{ "title": "V1BenchmarkOptimizeRequest", "type": "object", "properties": { "job_description": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Job Description" } } }
- Fields:
- field job_description: Any | None = None
- pydantic model V1CreateBaseJobModel
Bases:
BaseModelPydantic base class create job request
Show JSON schema
{ "title": "V1CreateBaseJobModel", "description": "Pydantic base class create job request", "type": "object", "properties": { "job_id": { "title": "Job Id", "type": "string" }, "job_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Job Type" }, "job_description": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Job Description" }, "user_id": { "title": "User Id", "type": "string" } }, "required": [ "job_id", "user_id" ] }
- field job_description: Any | None = None
- field job_id: str [Required]
- field job_type: str | None = None
- field user_id: str [Required]
- pydantic model V1CreateGenericJobModel
Bases:
V1CreateBaseJobModelPydantic class create generic job request
Show JSON schema
{ "title": "V1CreateGenericJobModel", "description": "Pydantic class create generic job request", "type": "object", "properties": { "job_id": { "title": "Job Id", "type": "string" }, "job_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Job Type" }, "job_description": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Job Description" }, "user_id": { "title": "User Id", "type": "string" }, "data": { "title": "Data", "type": "object" }, "job_info": { "$ref": "#/$defs/V1JobTypesResponse" } }, "$defs": { "V1JobTypesDefaultParams": { "properties": { "nodepool_label": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "", "title": "Nodepool Label" }, "memory": { "default": 0.5, "title": "Memory", "type": "number" }, "memory_scale": { "default": "Gi", "title": "Memory Scale", "type": "string" }, "cpu": { "default": 25, "title": "Cpu", "type": "integer" }, "cpu_scale": { "default": "m", "title": "Cpu Scale", "type": "string" }, "gpu": { "default": 0, "title": "Gpu", "type": "integer" }, "min_scale": { "default": 0, "title": "Min Scale", "type": "integer" }, "max_scale": { "default": 1, "title": "Max Scale", "type": "integer" }, "autoscaling_class": { "default": "kpa.autoscaling.knative.dev", "description": "Class for pod autoscaling. 'kpa' supports metrics: 'concurrency' and 'rps' and 'hpa' supports metrics: 'cpu' and 'memory'", "enum": [ "kpa.autoscaling.knative.dev", "hpa.autoscaling.knative.dev" ], "title": "Autoscaling Class", "type": "string" }, "autoscaling_metric": { "default": "concurrency", "description": "Autoscaling metric to determine when pod should scale", "enum": [ "concurrency", "rps", "cpu", "memory" ], "title": "Autoscaling Metric", "type": "string" }, "autoscaling_target": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": 200, "description": "Target amount to trigger scaling of additional pods.", "title": "Autoscaling Target" }, "readiness_probe": { "anyOf": [ { "$ref": "#/$defs/V1JobTypesReadinesProbeParams" }, { "type": "null" } ], "default": null, "description": "Parameters to set up kubernetes httpGet readinessProbe for a pod. If not specified, default is to not create a one." }, "image_pull_secrets": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "Name of image pull secret to use to pull image from private registry.", "title": "Image Pull Secrets" }, "image_pull_policy": { "default": "Always", "description": "Image pull policy", "enum": [ "Always", "Never", "IfNotPresent" ], "title": "Image Pull Policy", "type": "string" }, "labels": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "Dictionary of labels to add to job. If not specified, default is to set to None so no labels added.", "title": "Labels" }, "suspend": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "Whether or not a job should start in a suspended state. If not specified, default is set to False.", "title": "Suspend" }, "idle_time_limit": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The duration the last replica will wait before scaling down but only if there is no traffic during this period. Possible values are in the range of 6 seconds to 1 hour. Specify an amount with the respective unit, `s` for seconds, `m` for minutes, and `h` for hour.", "title": "Idle Time Limit" } }, "title": "V1JobTypesDefaultParams", "type": "object" }, "V1JobTypesReadinesProbeParams": { "properties": { "host": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Host name to connect to, defaults to the pod IP", "title": "Host" }, "port": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name or number of the port to access on the container. Number must be in the range 1 to 65535.", "title": "Port" }, "scheme": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "HTTP", "description": "Scheme to use for connecting to the host (HTTP or HTTPS). Defaults to 'HTTP'", "title": "Scheme" }, "path": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "/", "description": "Path to access on the HTTP server. Defaults to ' / '.", "title": "Path" } }, "title": "V1JobTypesReadinesProbeParams", "type": "object" }, "V1JobTypesResponse": { "properties": { "name": { "description": "job type name", "title": "Name", "type": "string" }, "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "job type description", "title": "Description" }, "status": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "active", "description": "job type status", "title": "Status" }, "image_url": { "description": "job type's image url", "title": "Image Url", "type": "string" }, "default_params": { "$ref": "#/$defs/V1JobTypesDefaultParams", "default": { "nodepool_label": "", "memory": 0.5, "memory_scale": "Gi", "cpu": 25, "cpu_scale": "m", "gpu": 0, "min_scale": 0, "max_scale": 1, "autoscaling_class": "kpa.autoscaling.knative.dev", "autoscaling_metric": "concurrency", "autoscaling_target": 200, "readiness_probe": null, "image_pull_secrets": null, "image_pull_policy": "Always", "labels": null, "suspend": false, "idle_time_limit": null }, "description": "job type default params" }, "volume_mounts": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "job type default volume_mounts", "title": "Volume Mounts" }, "environment_variables": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "job type default environment_variables", "title": "Environment Variables" }, "port": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": 8080, "description": "Job port. Default: 8080", "title": "Port" }, "runtime_object": { "description": "Job's runtime_object. Accepted values: `knative`, `kubernetes`", "enum": [ "knative", "kubernetes" ], "title": "Runtime Object", "type": "string" }, "uuid": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "job type uuid", "title": "Uuid" }, "created_ts": { "anyOf": [ { "format": "date-time", "type": "string" }, { "type": "null" } ], "default": null, "description": "Unix time in milliseconds generated at creation time.", "title": "Created Ts" }, "modified_ts": { "anyOf": [ { "format": "date-time", "type": "string" }, { "type": "null" } ], "default": null, "description": "Unix time in milliseconds generated at last modification time.", "title": "Modified Ts" }, "created_by": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "User that created the job_type.", "title": "Created By" }, "modified_by": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "User that modified the job_type.", "title": "Modified By" } }, "required": [ "name", "image_url", "runtime_object" ], "title": "V1JobTypesResponse", "type": "object" } }, "required": [ "job_id", "user_id", "data", "job_info" ] }
- field data: dict [Required]
- field job_info: V1JobTypesResponse [Required]
- pydantic model V1CreateJobModel
Bases:
V1CreateBaseJobModelPydantic class create job request
Show JSON schema
{ "title": "V1CreateJobModel", "description": "Pydantic class create job request", "type": "object", "properties": { "job_id": { "title": "Job Id", "type": "string" }, "job_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Job Type" }, "job_description": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Job Description" }, "user_id": { "title": "User Id", "type": "string" }, "data": { "discriminator": { "mapping": { "dataloading": "#/$defs/V1DataloadingJob", "driftdetection": "#/$defs/V1DriftDetectionJob", "join_preprocessing": "#/$defs/V1PreprocessingJoinJob", "modelperformance": "#/$defs/V1ModelPerformanceJob", "preprocessing": "#/$defs/V1PreprocessingJob" }, "propertyName": "job_type" }, "oneOf": [ { "$ref": "#/$defs/V1DataloadingJob" }, { "$ref": "#/$defs/V1PreprocessingJoinJob" }, { "$ref": "#/$defs/V1PreprocessingJob" }, { "$ref": "#/$defs/V1ModelPerformanceJob" }, { "$ref": "#/$defs/V1DriftDetectionJob" } ], "title": "Data" }, "job_info": { "anyOf": [ { "$ref": "#/$defs/V1JobTypesResponse" }, { "type": "null" } ], "default": null } }, "$defs": { "V1Baseline": { "properties": { "window_method": { "description": "The window method. Supported values: `prior`, `last`, `same_prior_year`, `training` .", "title": "Window Method", "type": "string" }, "window_type": { "description": "The baseline window type. Supported values: `day`, `week`, `month`, `quarter`, `year`, `training`.", "title": "Window Type", "type": "string" }, "last_amount": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The last amount of `prior` or `last` for the given window type.", "title": "Last Amount" }, "process_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The process date.", "title": "Process Date" }, "offset_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The policy`s offset type. Supported values: `week`, `month`, and `quarter`.", "title": "Offset Type" }, "offset": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The offset amount.", "title": "Offset" }, "start_of_week": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The start day of week. Supported values: `monday`, `tuesday`, `wednesday`, `thursday`, `friday`, `saturday`, `sunday`.", "title": "Start Of Week" }, "quarter_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the quarter.", "title": "Quarter Start" }, "year_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the year.", "title": "Year Start" } }, "required": [ "window_method", "window_type" ], "title": "V1Baseline", "type": "object" }, "V1BetweenOperatorModel": { "properties": { "min": { "default": null, "description": "Minimum value of BETWEEN.", "title": "Min", "type": "number" }, "max": { "default": null, "description": "Maximum value of BETWEEN.", "title": "Max", "type": "number" } }, "title": "V1BetweenOperatorModel", "type": "object" }, "V1DataloadingJob": { "properties": { "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "Data description.", "title": "Description" }, "dryrun": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "Dry run determines if data is NOT to be saved in a table. Default value is `False` and data is saved.", "title": "Dryrun" }, "dtypes": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "A list of pandas data types as a string instance.", "title": "Dtypes" }, "filetype": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "parquet", "description": "File type containing data to be loaded. Acceptable values include: `csv`, 'json`, and 'paquet`. Parquet file types are recommended over json or csv files. Default value is `parquet`.", "title": "Filetype" }, "overwrite": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "Replace", "description": "Determines how to manage data if already exists. Supported values: `replace` (overwrite existing data) and `append` (add new data to existing data).", "title": "Overwrite" }, "separator": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": ",", "description": "Data separator.", "title": "Separator" }, "setname": { "description": "Feature set name.", "title": "Setname", "type": "string" }, "tablename": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Table name.", "title": "Tablename" }, "srcurl": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Source url fron where data is to be loaded.", "title": "Srcurl" }, "upload_key": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Cache upload key.", "title": "Upload Key" }, "job_description": { "anyOf": [ { "type": "string" }, { "type": "object" }, { "type": "null" } ], "default": null, "description": "Job description.", "title": "Job Description" }, "job_type": { "const": "dataloading", "default": "dataloading", "description": "Job type. Supports one value: dataloading (the default value).", "title": "Job Type", "type": "string" }, "maintain_archives": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "If `true` creates an archive table of a snapshot of the data before it is overwritten or appended; otherwise, `false` (the default value).", "title": "Maintain Archives" }, "connectionname": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "Internal clickhouse DB", "description": "Connection name must match one of the connections already in data source connection list.", "title": "Connectionname" }, "tabs": { "anyOf": [ { "items": { "$ref": "#/$defs/V1TableDetails" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "tabs containing sheet information of workbook", "title": "Tabs" }, "engine": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Engine clause appended to CREATE TABLE for some databases if supplied ie 'ENGINE = MergeTree order by (columname)' .", "title": "Engine" }, "table_structure_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "cf3_3_0_r_1_table_structure", "description": "the name of the table structure/schema.", "title": "Table Structure Name" }, "enforce_table_structure": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "If `true` enforces the table structure/schema; otherwise, `false` (the default value).", "title": "Enforce Table Structure" } }, "required": [ "setname" ], "title": "V1DataloadingJob", "type": "object" }, "V1DriftDetectionJob": { "created_by": "vianai", "created_ts": 1679496214659.72, "deployment": "vianai.d_mp_placeholder_deployment", "description": "Description of Policy", "job_type": "driftdetection", "model_name": "vianai.d_mp_placeholder_deployment", "model_stage": "primary", "model_version": "1", "modified_by": "vianai", "modified_ts": 1679496214659.72, "name": "vianai.d_mp_placeholder_deployment.vianai_d_mp_d_mp_placeholder_deployment_1_policy", "policy": { "critical_level": 0.25, "deployment_name": "vianai.d_mp_placeholder_deployment", "drift_measure": "PSI", "drift_type": "distance", "feature_weightage": "equal", "feature_weights": { "est_fare_amount": 25, "extra": 25, "travel_time": 25, "trip_distance": 25 }, "method": "preprocess", "schedule": "0 0 5 ? * *", "select_features_type": "custom", "type": "feature-drift", "warning_level": 0.1, "window_parameters": { "baseline": { "last_amount": 2, "window_method": "last", "window_type": "week" }, "target": { "window_type": "week" } } }, "properties": { "deployment": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the deployment.", "title": "Deployment" }, "model_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the model.", "title": "Model Name" }, "job_type": { "const": "driftdetection", "default": "driftdetection", "description": "Drift detection type.", "title": "Job Type", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The version of the model, e.g., 1.", "title": "Model Version" }, "model_stage": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The stage of the model, e.g., primary.", "title": "Model Stage" }, "name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the policy.", "title": "Name" }, "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Parameters passed to the drift detection job.", "title": "Description" }, "type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The type of policy.", "title": "Type" }, "policy": { "$ref": "#/$defs/V1DriftPolicy", "description": "drift policy for detection" }, "drift_policies": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "Extending support for legacy drift policies.", "title": "Drift Policies" }, "status": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "active", "description": "The status of policy, such as `active` or `inactive`.", "title": "Status" }, "segments": { "description": "List of segments in drift detection policies.", "items": { "$ref": "#/$defs/V1SegmentModel" }, "title": "Segments", "type": "array" }, "uuid": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "UUID for the drift policy", "title": "Uuid" }, "created_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the drift policy is created. You can specify the timestamp as a float or date time string value.", "title": "Created Ts" }, "modified_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the drift policy is modified. You can specify the timestamp as a float or date time string value.", "title": "Modified Ts" }, "created_by": { "description": "User who created the segment.", "title": "Created By", "type": "string" }, "modified_by": { "description": "User who last modified the segment.", "title": "Modified By", "type": "string" } }, "required": [ "policy", "segments", "created_ts", "modified_ts", "created_by", "modified_by" ], "segments": [ { "created_by": "vianai", "created_ts": 1679496214358.969, "description": "Segment to filter data for particular Pickup and Dropoff locations", "filters": [ { "conjunction": "and", "feature_name": "PULocationID", "grouped_filters": null, "operator": "=", "value": [ "256", "217" ] }, { "conjunction": null, "feature_name": "DOLocationID", "grouped_filters": null, "operator": "=", "value": [ "144", "148" ] } ], "id": 1, "model_uuid": "ff0f98ae-5b59-48dd-8567-14efce48b4b4", "modified_by": "vianai", "modified_ts": 1679496214358.969, "name": "vianai.d_mp_placeholder_deployment_segment_1", "status": "active" } ], "status": "inactive", "title": "V1DriftDetectionJob", "type": "drift", "uuid": "76ce26d2-a41c-4390-b015-52d7a606aeec" }, "V1DriftPolicy": { "example": { "critical_level": 0.25, "deployment_name": "d_mp_placeholder_deployment", "hotspot": { "features": [ "a", "b", "c" ], "method": "flat", "value": 50 }, "method": "preprocess", "schedule": "0 0 5 ? * *", "warning_level": 0.1, "window_parameters": { "baseline": { "last_amount": 2, "window_method": "last", "window_type": "week" }, "target": { "window_type": "week" } } }, "properties": { "window_parameters": { "$ref": "#/$defs/V1WindowParameters", "description": "The window parameters, which include the target and baseline parameters." }, "warning_level": { "anyOf": [ { "type": "number" }, { "type": "integer" } ], "description": "The warning level value. For distance based drift and performance drift, the expected value type is a float. For window based drift, the expected value type is an integer.", "title": "Warning Level" }, "critical_level": { "anyOf": [ { "type": "number" }, { "type": "integer" } ], "description": "The critical level value. For distance based drift and performance drift, the expected value type is a float. For window based drift, the expected value type is an integer.", "title": "Critical Level" }, "schedule": { "description": "The cron scheduleer.", "title": "Schedule", "type": "string" }, "deployment_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The name of the deployment the policy belongs to.", "title": "Deployment Name" }, "method": { "description": "The drift method.", "title": "Method", "type": "string" }, "hotspot_analysis": { "anyOf": [ { "$ref": "#/$defs/V1HotspotParamsModel" }, { "type": "null" } ], "default": { "method": "percent", "value": 100, "features": [] }, "description": "Parameters that determine the features to run hotspot analysis against and level of traffic to include." }, "type": { "description": "The drift category. Supported values: `feature-drift`, `prediction-drift`.", "title": "Type", "type": "string" }, "drift_type": { "description": "The type of drift. Supported values: `distance`, `windowed`.", "title": "Drift Type", "type": "string" }, "select_features_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The features to be included in drift policy. Supported values: `custom`, `all`.", "title": "Select Features Type" }, "feature_weightage": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The weight category selected for the included features. Supported values: `equal`, `manual`.", "title": "Feature Weightage" }, "feature_weights": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "The specific weight given to each feature.", "title": "Feature Weights" }, "drift_measure": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The drift measure. Supported values: `PSI`, `JS`.", "title": "Drift Measure" }, "baseline_bins": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "The custom bin dictionary for which to run drift against per feature.", "title": "Baseline Bins" } }, "required": [ "window_parameters", "warning_level", "critical_level", "schedule", "method", "type", "drift_type" ], "title": "V1DriftPolicy", "type": "object" }, "V1HotspotParamsModel": { "example": { "hotspot": { "features": [ "a", "b", "c" ], "method": "flat", "value": 50 } }, "properties": { "method": { "description": "Method for selecting top hotspot results. Currently supported values: `flat` (straight number limit) and `percent` (top value % of the hotspots results).", "enum": [ "flat", "percent" ], "title": "Method", "type": "string" }, "value": { "description": "Integer value that correlates to the selected method. If using percent as the selected method, number can never be greater than 100.", "title": "Value", "type": "integer" }, "features": { "description": "List of hotspot features (of categorical data type) to be used when performing hotspot analysis.", "items": { "type": "string" }, "title": "Features", "type": "array" } }, "required": [ "method", "value", "features" ], "title": "V1HotspotParamsModel", "type": "object" }, "V1InferenceMappingColumnSchema": { "properties": { "feature_id": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Id of the feature, generated by the platform for optimization.", "title": "Feature Id" }, "name": { "description": "Name of column.", "title": "Name", "type": "string" }, "dtype": { "description": "Data type of column. For example, `float64`.", "title": "Dtype", "type": "string" }, "sql_type": { "description": "SQL data type of column. For example, `Float32`.", "title": "Sql Type", "type": "string" }, "feature_type": { "description": "Feature type of column. Acceptable values include `categorical` and `continuous`.", "title": "Feature Type", "type": "string" }, "segmentation": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": true, "description": "If true (the default), the column is enabled for segmentation calculations.", "title": "Segmentation" }, "drift": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": true, "description": "If true (the default), the column is enabled for drift calculations.", "title": "Drift" }, "hotspot": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "If true (the default), the column is enabled for hotspot analysis.", "title": "Hotspot" }, "rca": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "List of column names included for root cause analysis (rca). Set by the platform based on feature configuration to identify features available for hotspot analysis.", "title": "Rca" }, "round": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The number of decimals to round to on a continuous float column.", "title": "Round" } }, "required": [ "name", "dtype", "sql_type", "feature_type" ], "title": "V1InferenceMappingColumnSchema", "type": "object" }, "V1InferenceMappingModel": { "example": { "connection": "Internal clickhouse DB", "create_ddl": null, "deployment": "vianai.jt_placeholder_deployment", "df_schema": { "columns": [ { "drift": true, "dtype": "float64", "feature_id": 1, "feature_type": "categorical", "name": "PULocationID", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 2, "feature_type": "categorical", "name": "DOLocationID", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 3, "feature_type": "continuous", "name": "trip_distance", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 4, "feature_type": "continuous", "name": "travel_time", "segmentation": true, "sql_type": "Float32" }, { "drift": false, "dtype": "datetime64[ns]", "feature_id": 5, "feature_type": "unknown", "name": "PUdatetime", "sql_type": "" } ], "datetime_col": "PUdatetime", "identifier_cols": [ "pk" ], "target_col": "total_amount" }, "ground_truth_table": "16794179557100_gt", "identifier_cols_schema": null, "index": 7, "inference_table": "16794179557100_dit", "joined_table": "16794179557100_joined", "key_table": "16794179557100_key", "model_name": "vianai.jt_placeholder_deployment", "model_stage": "primary", "model_version": "1", "postprocessors": [ { "classname": "vianai.postprocessing.classification.PickInferenceMapper", "initparams": { "mapper": "{1:'a',2:'b',3:'c'}" }, "method": "fit_transform" } ] }, "properties": { "index": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Index identifier.", "title": "Index" }, "deployment": { "description": "Deployment name for the related model.", "title": "Deployment", "type": "string" }, "model_name": { "description": "Model name for the related model.", "title": "Model Name", "type": "string" }, "model_version": { "description": "Model version for the related model, e.g., 1.", "title": "Model Version", "type": "string" }, "model_stage": { "description": "Model stage for the related model, e.g., primary.", "title": "Model Stage", "type": "string" }, "connection": { "description": "Database connection for the inference mapping.", "title": "Connection", "type": "string" }, "df_schema": { "$ref": "#/$defs/V1InferenceMappingSchema", "description": "Dictionary containing dataframe schema for model, i.e., target column, identifier column(s), all columns, datetime column, and predict probability column (classification models only)." }, "identifier_cols_schema": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "List containing identifier columns schema for model.", "title": "Identifier Cols Schema" }, "inference_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of inference table for mapping.", "title": "Inference Table" }, "ground_truth_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of ground truth table for mapping.", "title": "Ground Truth Table" }, "joined_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of joined table for mapping.", "title": "Joined Table" }, "key_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of key table for mapping.", "title": "Key Table" }, "create_ddl": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The query to create the ddl tables.", "title": "Create Ddl" }, "postprocessors": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "One or more postprocessor (and related params) to include in inference mapping, to transform output data before sending to backend database. The available postprocessors include `PickHighestProbability`, `PickInferenceMapper`, and `PickProbablityThreshold`. For each postprocessor, specify the classname, method, and initparams.", "title": "Postprocessors" }, "training_set_id": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Training set id that needs to be specified for training data preprocessing.", "title": "Training Set Id" }, "training_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Training table name that needs to be specified for training data preprocessing.", "title": "Training Table" } }, "required": [ "deployment", "model_name", "model_version", "model_stage", "connection", "df_schema" ], "title": "V1InferenceMappingModel", "type": "object" }, "V1InferenceMappingSchema": { "properties": { "target_col": { "description": "Name of target column.", "title": "Target Col", "type": "string" }, "identifier_cols": { "default": [], "description": "List of identifier columns.", "items": { "type": "string" }, "title": "Identifier Cols", "type": "array" }, "columns": { "description": "List of all columns.", "items": { "$ref": "#/$defs/V1InferenceMappingColumnSchema" }, "title": "Columns", "type": "array" }, "datetime_col": { "default": "", "description": "Name of datetime column", "title": "Datetime Col", "type": "string" }, "predict_proba_col": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "(Classification models only) Name of column that provides the predict probability.", "title": "Predict Proba Col" } }, "required": [ "target_col", "columns" ], "title": "V1InferenceMappingSchema", "type": "object" }, "V1JobTypesDefaultParams": { "properties": { "nodepool_label": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "", "title": "Nodepool Label" }, "memory": { "default": 0.5, "title": "Memory", "type": "number" }, "memory_scale": { "default": "Gi", "title": "Memory Scale", "type": "string" }, "cpu": { "default": 25, "title": "Cpu", "type": "integer" }, "cpu_scale": { "default": "m", "title": "Cpu Scale", "type": "string" }, "gpu": { "default": 0, "title": "Gpu", "type": "integer" }, "min_scale": { "default": 0, "title": "Min Scale", "type": "integer" }, "max_scale": { "default": 1, "title": "Max Scale", "type": "integer" }, "autoscaling_class": { "default": "kpa.autoscaling.knative.dev", "description": "Class for pod autoscaling. 'kpa' supports metrics: 'concurrency' and 'rps' and 'hpa' supports metrics: 'cpu' and 'memory'", "enum": [ "kpa.autoscaling.knative.dev", "hpa.autoscaling.knative.dev" ], "title": "Autoscaling Class", "type": "string" }, "autoscaling_metric": { "default": "concurrency", "description": "Autoscaling metric to determine when pod should scale", "enum": [ "concurrency", "rps", "cpu", "memory" ], "title": "Autoscaling Metric", "type": "string" }, "autoscaling_target": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": 200, "description": "Target amount to trigger scaling of additional pods.", "title": "Autoscaling Target" }, "readiness_probe": { "anyOf": [ { "$ref": "#/$defs/V1JobTypesReadinesProbeParams" }, { "type": "null" } ], "default": null, "description": "Parameters to set up kubernetes httpGet readinessProbe for a pod. If not specified, default is to not create a one." }, "image_pull_secrets": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "Name of image pull secret to use to pull image from private registry.", "title": "Image Pull Secrets" }, "image_pull_policy": { "default": "Always", "description": "Image pull policy", "enum": [ "Always", "Never", "IfNotPresent" ], "title": "Image Pull Policy", "type": "string" }, "labels": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "Dictionary of labels to add to job. If not specified, default is to set to None so no labels added.", "title": "Labels" }, "suspend": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "Whether or not a job should start in a suspended state. If not specified, default is set to False.", "title": "Suspend" }, "idle_time_limit": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The duration the last replica will wait before scaling down but only if there is no traffic during this period. Possible values are in the range of 6 seconds to 1 hour. Specify an amount with the respective unit, `s` for seconds, `m` for minutes, and `h` for hour.", "title": "Idle Time Limit" } }, "title": "V1JobTypesDefaultParams", "type": "object" }, "V1JobTypesReadinesProbeParams": { "properties": { "host": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Host name to connect to, defaults to the pod IP", "title": "Host" }, "port": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name or number of the port to access on the container. Number must be in the range 1 to 65535.", "title": "Port" }, "scheme": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "HTTP", "description": "Scheme to use for connecting to the host (HTTP or HTTPS). Defaults to 'HTTP'", "title": "Scheme" }, "path": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "/", "description": "Path to access on the HTTP server. Defaults to ' / '.", "title": "Path" } }, "title": "V1JobTypesReadinesProbeParams", "type": "object" }, "V1JobTypesResponse": { "properties": { "name": { "description": "job type name", "title": "Name", "type": "string" }, "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "job type description", "title": "Description" }, "status": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "active", "description": "job type status", "title": "Status" }, "image_url": { "description": "job type's image url", "title": "Image Url", "type": "string" }, "default_params": { "$ref": "#/$defs/V1JobTypesDefaultParams", "default": { "nodepool_label": "", "memory": 0.5, "memory_scale": "Gi", "cpu": 25, "cpu_scale": "m", "gpu": 0, "min_scale": 0, "max_scale": 1, "autoscaling_class": "kpa.autoscaling.knative.dev", "autoscaling_metric": "concurrency", "autoscaling_target": 200, "readiness_probe": null, "image_pull_secrets": null, "image_pull_policy": "Always", "labels": null, "suspend": false, "idle_time_limit": null }, "description": "job type default params" }, "volume_mounts": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "job type default volume_mounts", "title": "Volume Mounts" }, "environment_variables": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "description": "job type default environment_variables", "title": "Environment Variables" }, "port": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": 8080, "description": "Job port. Default: 8080", "title": "Port" }, "runtime_object": { "description": "Job's runtime_object. Accepted values: `knative`, `kubernetes`", "enum": [ "knative", "kubernetes" ], "title": "Runtime Object", "type": "string" }, "uuid": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "job type uuid", "title": "Uuid" }, "created_ts": { "anyOf": [ { "format": "date-time", "type": "string" }, { "type": "null" } ], "default": null, "description": "Unix time in milliseconds generated at creation time.", "title": "Created Ts" }, "modified_ts": { "anyOf": [ { "format": "date-time", "type": "string" }, { "type": "null" } ], "default": null, "description": "Unix time in milliseconds generated at last modification time.", "title": "Modified Ts" }, "created_by": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "User that created the job_type.", "title": "Created By" }, "modified_by": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "User that modified the job_type.", "title": "Modified By" } }, "required": [ "name", "image_url", "runtime_object" ], "title": "V1JobTypesResponse", "type": "object" }, "V1ModelPerformanceJob": { "example": { "deployment_name": "deployment_xyz", "job_description": { "deployment_name": "deployment_xyz", "deployment_type": "vianai-v2" }, "job_type": "modelperformance", "method": "preprocess", "model_name": "vianai.model_name", "model_stage": "primary", "model_version": "1" }, "properties": { "deployment_name": { "description": "The name of the deployment.", "title": "Deployment Name", "type": "string" }, "model_name": { "description": "The name of the model.", "title": "Model Name", "type": "string" }, "job_type": { "const": "modelperformance", "default": "modelperformance", "description": "Supports the model performance job.", "title": "Job Type", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The version of the model, e.g., 1.", "title": "Model Version" }, "model_stage": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The stage of the model, e.g., primary.", "title": "Model Stage" }, "job_description": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "Parameters passed to the model performance job. For example, \"job_description\":{\"deployment_name\":\"deployment_xyz\",\"deployment_type\":\"vianai-v2\"}}", "title": "Job Description" }, "method": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "preprocess", "description": "The model performance method. Supported values: `LLM`, `preprocess` (the default value),.", "title": "Method" }, "joined_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The merged table with inference data and ground truth data on qna io uuid.", "title": "Joined Table" }, "task_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Differentiates between LLM monitoring and benchmarking model performance. Supported values: `benchmarking`, `monitoring`.", "title": "Task Type" }, "im_index": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Inference mapping index associated with model.", "title": "Im Index" } }, "required": [ "deployment_name", "model_name" ], "title": "V1ModelPerformanceJob", "type": "object" }, "V1PreprocessingJob": { "properties": { "inference_mapping": { "$ref": "#/$defs/V1InferenceMappingModel" }, "process_window": { "anyOf": [ { "$ref": "#/$defs/V1PreprocessingProcessWindow" }, { "type": "null" } ], "default": null }, "job_type": { "const": "preprocessing", "default": "preprocessing", "title": "Job Type", "type": "string" }, "method": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "preprocess", "title": "Method" }, "refresh": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "title": "Refresh" } }, "required": [ "inference_mapping" ], "title": "V1PreprocessingJob", "type": "object" }, "V1PreprocessingJoinJob": { "properties": { "inference_mapping": { "$ref": "#/$defs/V1InferenceMappingModel" }, "process_window": { "anyOf": [ { "$ref": "#/$defs/V1PreprocessingJoinProcessWindow" }, { "type": "null" } ], "default": null }, "method": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "join", "title": "Method" }, "job_type": { "const": "join_preprocessing", "default": "join_preprocessing", "title": "Job Type", "type": "string" } }, "required": [ "inference_mapping" ], "title": "V1PreprocessingJoinJob", "type": "object" }, "V1PreprocessingJoinProcessWindow": { "example": { "batch_size": 60, "end_time": "2023-03-21 18:00:00", "start_time": "2023-03-21 11:00:00" }, "properties": { "start_time": { "default": null, "description": "tart time for process window (in string format), with method join.", "title": "Start Time", "type": "string" }, "end_time": { "default": null, "description": "End time for process window (in string format), with method join.", "title": "End Time", "type": "string" }, "batch_size": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Batch size for process window (in integer format) with method join.", "title": "Batch Size" } }, "title": "V1PreprocessingJoinProcessWindow", "type": "object" }, "V1PreprocessingProcessWindow": { "example": { "end_date": "2023-03-16", "start_date": "2023-02-07" }, "properties": { "start_date": { "default": null, "description": "Start date in string for process window (in string format), formatted as yyy-mm-dd.", "title": "Start Date", "type": "string" }, "end_date": { "default": null, "description": "End date in string for process window (in string format), formatted as yyy-mm-dd.", "title": "End Date", "type": "string" } }, "title": "V1PreprocessingProcessWindow", "type": "object" }, "V1SegmentFilterModel": { "additionalProperties": false, "example": { "conjunction": "AND", "feature_name": "FEATURE NAME", "grouped_filters": [ { "conjunction": "AND", "feature_name": "FEATURE NAME", "operator": "=", "value": [ "VALUE 1", "VALUE 2" ] } ], "operator": "=", "value": [ "VALUE 1", "VALUE 2" ] }, "properties": { "feature_name": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of feature field to do the operation on.", "title": "Feature Name" }, "value": { "anyOf": [ { "items": { "anyOf": [ { "type": "string" }, { "type": "integer" }, { "type": "boolean" }, { "type": "number" } ] }, "type": "array" }, { "type": "string" }, { "type": "integer" }, { "type": "boolean" }, { "type": "number" }, { "$ref": "#/$defs/V1BetweenOperatorModel" }, { "$ref": "#/$defs/V1TopBottomOperatorModel" }, { "type": "null" } ], "default": null, "description": "Values of operator doing the filter. Value types supported are based on operator.", "title": "Value" }, "operator": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Operation to perform on the feature field. This field is case-insensitive. Supported operators: `=`, `>`, `<`, `<=`, `>=`, `BETWEEN`, `TOP`, `BOTTOM`, `DISTINCT`", "title": "Operator" }, "conjunction": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Relationship to next filter. If there is no next filter, set to null. This field is case-insensitive. Supported values: `AND`, `OR`, `null`. Default value is `null`.", "title": "Conjunction" }, "grouped_filters": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of grouped filters. Use for creating a nested filter within a filter.", "title": "Grouped Filters" } }, "title": "V1SegmentFilterModel", "type": "object" }, "V1SegmentModel": { "example": { "created_by": "user1", "created_ts": 1672531200000, "description": "DESCRIPTION", "filters": [ { "conjunction": null, "feature_name": "FEATURE NAME", "grouped_filters": null, "operator": "=", "value": [ "VALUE 1", "VALUE 2" ] } ], "id": 1, "model_uuid": "5efc9544-e84a-4a94-9e6d-5774e1c609ab", "modified_by": "user2", "modified_ts": 1672531200000, "name": "NAME", "status": "inactive" }, "properties": { "model_uuid": { "description": "Unique identifier for model.", "title": "Model Uuid", "type": "string" }, "name": { "description": "Name of the segment.", "title": "Name", "type": "string" }, "description": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Description of the segment.", "title": "Description" }, "filters": { "description": "List of segment filters, their conditions, and relationships.", "items": { "$ref": "#/$defs/V1SegmentFilterModel" }, "title": "Filters", "type": "array" }, "id": { "description": "Unique identifier generated by the platform for the segment.", "title": "Id", "type": "integer" }, "status": { "description": "Current status of the segment. This field is case-insensitive. Possible values: `active`, `inactive` (default), `archived`, `delete`.", "title": "Status", "type": "string" }, "created_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the segment is created. You can specify the timestamp as a float or date time string value.", "title": "Created Ts" }, "modified_ts": { "anyOf": [ { "type": "number" }, { "format": "date-time", "type": "string" } ], "description": "Timestamp (Unix time in milliseconds) generated when the segment is modified. You can specify the timestamp as a float or date time string value.", "title": "Modified Ts" }, "created_by": { "description": "User who created the segment.", "title": "Created By", "type": "string" }, "modified_by": { "description": "User who last modified the segment.", "title": "Modified By", "type": "string" } }, "required": [ "model_uuid", "name", "filters", "id", "status", "created_ts", "modified_ts", "created_by", "modified_by" ], "title": "V1SegmentModel", "type": "object" }, "V1TableDetails": { "properties": { "tabname": { "default": null, "description": "sheet name in workbook", "title": "Tabname", "type": "string" }, "columns": { "default": null, "description": "List of colmunname", "items": { "type": "string" }, "title": "Columns", "type": "array" } }, "title": "V1TableDetails", "type": "object" }, "V1Target": { "properties": { "window_type": { "description": "The target window type. Accepted values include: `day`, `week`, `month`, `quarter`, and `year`.", "title": "Window Type", "type": "string" }, "process_date": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The process date.", "title": "Process Date" }, "offset_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The policy`s offset type. Accepted values include: `week`, `month`, and `quarter`.", "title": "Offset Type" }, "offset": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The offset amount.", "title": "Offset" }, "start_of_week": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The start day of week. Supported values: `monday`, `tuesday`, `wednesday`, `thursday`, `friday`, `saturday`, `sunday`.", "title": "Start Of Week" }, "quarter_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the quarter.", "title": "Quarter Start" }, "year_start": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The date to start the year.", "title": "Year Start" } }, "required": [ "window_type" ], "title": "V1Target", "type": "object" }, "V1TopBottomOperatorModel": { "properties": { "direction": { "default": "DESC", "description": "Direction of field values. This field is case-insensitive. Supported directions: `ASC` (ascending), `DESC` (descending). Default is `DESC`.", "title": "Direction", "type": "string" }, "method": { "default": "flat", "description": "Whether it should be the top/bottom percent or flat amount. This field is case-insensitive. Supported methods: `percent`, `flat`. Default is `flat`.", "title": "Method", "type": "string" }, "value": { "default": null, "description": "Percent or flat number of rows to take.", "title": "Value", "type": "number" } }, "title": "V1TopBottomOperatorModel", "type": "object" }, "V1WindowParameters": { "properties": { "target": { "$ref": "#/$defs/V1Target", "description": "The target parameters." }, "baseline": { "$ref": "#/$defs/V1Baseline", "description": "The baseline parameters." } }, "required": [ "target", "baseline" ], "title": "V1WindowParameters", "type": "object" } }, "required": [ "job_id", "user_id", "data" ] }
- field data: V1DataloadingJob | V1PreprocessingJoinJob | V1PreprocessingJob | V1ModelPerformanceJob | V1DriftDetectionJob [Required]
- field job_info: V1JobTypesResponse | None = None
- pydantic model V1JobModel
Bases:
BaseModelShow JSON schema
{ "title": "V1JobModel", "type": "object", "properties": { "job_id": { "description": "The job id.", "title": "Job Id", "type": "string" }, "job_type": { "description": "The job type. Supported values: `dataloading`, `dataprofiling`, `driftdetection`, `modelperformance`, `preprocessing`.", "title": "Job Type", "type": "string" }, "user_id": { "description": "User id.", "title": "User Id", "type": "string" }, "run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Run id.", "title": "Run Id" }, "status": { "description": "Job status. Supported values: `queued`, `done`.", "title": "Status", "type": "string" }, "statusdetails": { "description": "Status details.", "title": "Statusdetails", "type": "string" }, "result": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "Job results, if job status is `done`.", "title": "Result" }, "exception": { "description": "Exception details, if an exeption occurred while running the job.", "title": "Exception", "type": "string" }, "created": { "anyOf": [ { "format": "date-time", "type": "string" }, { "type": "null" } ], "default": null, "description": "The date and time the job pod was created.", "title": "Created" }, "started": { "description": "The date and time the job started.", "title": "Started", "type": "string" }, "finished": { "description": "The date and time the job finished.", "title": "Finished", "type": "string" }, "timestamp": { "description": "Job timestamp.", "title": "Timestamp", "type": "number" }, "configmap": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Configuration map.", "title": "Configmap" } }, "required": [ "job_id", "job_type", "user_id", "status", "statusdetails", "exception", "started", "finished", "timestamp" ] }
- Fields:
- field configmap: str | None = None
Configuration map.
- field created: datetime | None = None
The date and time the job pod was created.
- field exception: str [Required]
Exception details, if an exeption occurred while running the job.
- field finished: str [Required]
The date and time the job finished.
- field job_id: str [Required]
The job id.
- field job_type: str [Required]
The job type. Supported values: dataloading, dataprofiling, driftdetection, modelperformance, preprocessing.
- field result: Any | None = None
Job results, if job status is done.
- field run_id: str | None = None
Run id.
- field started: str [Required]
The date and time the job started.
- field status: str [Required]
Job status. Supported values: queued, done.
- field statusdetails: str [Required]
Status details.
- field timestamp: float [Required]
Job timestamp.
- field user_id: str [Required]
User id.
- pydantic model V1JobResponseList
Bases:
RootModelShow JSON schema
{ "title": "V1JobResponseList", "type": "array", "$defs": { "V1JobModel": { "properties": { "job_id": { "description": "The job id.", "title": "Job Id", "type": "string" }, "job_type": { "description": "The job type. Supported values: `dataloading`, `dataprofiling`, `driftdetection`, `modelperformance`, `preprocessing`.", "title": "Job Type", "type": "string" }, "user_id": { "description": "User id.", "title": "User Id", "type": "string" }, "run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Run id.", "title": "Run Id" }, "status": { "description": "Job status. Supported values: `queued`, `done`.", "title": "Status", "type": "string" }, "statusdetails": { "description": "Status details.", "title": "Statusdetails", "type": "string" }, "result": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "Job results, if job status is `done`.", "title": "Result" }, "exception": { "description": "Exception details, if an exeption occurred while running the job.", "title": "Exception", "type": "string" }, "created": { "anyOf": [ { "format": "date-time", "type": "string" }, { "type": "null" } ], "default": null, "description": "The date and time the job pod was created.", "title": "Created" }, "started": { "description": "The date and time the job started.", "title": "Started", "type": "string" }, "finished": { "description": "The date and time the job finished.", "title": "Finished", "type": "string" }, "timestamp": { "description": "Job timestamp.", "title": "Timestamp", "type": "number" }, "configmap": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Configuration map.", "title": "Configmap" } }, "required": [ "job_id", "job_type", "user_id", "status", "statusdetails", "exception", "started", "finished", "timestamp" ], "title": "V1JobModel", "type": "object" } }, "example": [ { "configmap": "config-job-queue-362526", "created": "2023-06-16 16:02:08.362534", "exception": "", "finished": "", "job_id": "job-queue-362526", "job_type": "job", "result": "", "started": "", "status": "queued", "statusdetails": "", "timestamp": 1686931328362.5432, "user_id": "user1" } ], "items": { "$ref": "#/$defs/V1JobModel" } }
- Config:
from_attributes: bool = True
json_schema_extra: dict = {‘example’: [{‘job_id’: ‘job-queue-362526’, ‘job_type’: ‘job’, ‘user_id’: ‘user1’, ‘status’: ‘queued’, ‘statusdetails’: ‘’, ‘result’: ‘’, ‘exception’: ‘’, ‘created’: ‘2023-06-16 16:02:08.362534’, ‘started’: ‘’, ‘finished’: ‘’, ‘timestamp’: 1686931328362.5432, ‘configmap’: ‘config-job-queue-362526’}]}
- Fields:
- field root: List[V1JobModel] [Required]
- pydantic model V1TransformJobInput
Bases:
BaseModelShow JSON schema
{ "title": "V1TransformJobInput", "type": "object", "properties": { "setname": { "title": "Setname", "type": "string" }, "label": { "title": "Label", "type": "string" }, "xformers": { "items": { "$ref": "#/$defs/V1TransformModel" }, "title": "Xformers", "type": "array" }, "combined": { "title": "Combined", "type": "boolean" }, "target_featureset_name": { "title": "Target Featureset Name", "type": "string" }, "split_by": { "title": "Split By", "type": "string" }, "split_args": { "title": "Split Args", "type": "object" } }, "$defs": { "V1TransformModel": { "properties": { "classname": { "title": "Classname", "type": "string" }, "columns": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Columns" }, "method": { "title": "Method", "type": "string" }, "initparams": { "title": "Initparams" }, "stateful": { "title": "Stateful", "type": "boolean" }, "serialized": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Serialized" } }, "required": [ "classname", "method", "initparams", "stateful" ], "title": "V1TransformModel", "type": "object" } }, "required": [ "setname", "label", "xformers", "combined", "target_featureset_name", "split_by", "split_args" ] }
- Fields:
- field combined: bool [Required]
- field label: str [Required]
- field setname: str [Required]
- field split_args: Dict [Required]
- field split_by: str [Required]
- field target_featureset_name: str [Required]
- field xformers: List[V1TransformModel] [Required]
- model_post_init(context: Any, /) None
This function is meant to behave like a BaseModel method to initialise private attributes.
It takes context as an argument since that’s what pydantic-core passes when calling it.
- Parameters:
self – The BaseModel instance.
context – The context.
- pydantic model V1TransformJobModel
Bases:
BaseModelShow JSON schema
{ "title": "V1TransformJobModel", "type": "object", "properties": { "job_id": { "title": "Job Id", "type": "string" }, "job_type": { "title": "Job Type", "type": "string" }, "job_description": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Job Description" }, "user_id": { "title": "User Id", "type": "string" }, "run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Run Id" }, "status": { "title": "Status", "type": "string" }, "statusdetails": { "title": "Statusdetails", "type": "string" }, "result": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Result" }, "exception": { "title": "Exception", "type": "string" }, "created": { "title": "Created", "type": "string" }, "started": { "title": "Started", "type": "string" }, "finished": { "title": "Finished", "type": "string" }, "timestamp": { "title": "Timestamp", "type": "number" }, "configmap": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Configmap" } }, "required": [ "job_id", "job_type", "user_id", "status", "statusdetails", "exception", "created", "started", "finished", "timestamp" ] }
- Fields:
- field configmap: str | None = None
- field created: str [Required]
- field exception: str [Required]
- field finished: str [Required]
- field job_description: Any | None = None
- field job_id: str [Required]
- field job_type: str [Required]
- field result: Any | None = None
- field run_id: str | None = None
- field started: str [Required]
- field status: str [Required]
- field statusdetails: str [Required]
- field timestamp: float [Required]
- field user_id: str [Required]
- pydantic model V1TransformJobResult
Bases:
BaseModelShow JSON schema
{ "title": "V1TransformJobResult", "type": "object", "properties": { "success": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": null, "title": "Success" }, "newsetname": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Newsetname" }, "input": { "anyOf": [ { "$ref": "#/$defs/V1TransformJobInput" }, { "type": "null" } ], "default": null } }, "$defs": { "V1TransformJobInput": { "properties": { "setname": { "title": "Setname", "type": "string" }, "label": { "title": "Label", "type": "string" }, "xformers": { "items": { "$ref": "#/$defs/V1TransformModel" }, "title": "Xformers", "type": "array" }, "combined": { "title": "Combined", "type": "boolean" }, "target_featureset_name": { "title": "Target Featureset Name", "type": "string" }, "split_by": { "title": "Split By", "type": "string" }, "split_args": { "title": "Split Args", "type": "object" } }, "required": [ "setname", "label", "xformers", "combined", "target_featureset_name", "split_by", "split_args" ], "title": "V1TransformJobInput", "type": "object" }, "V1TransformModel": { "properties": { "classname": { "title": "Classname", "type": "string" }, "columns": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Columns" }, "method": { "title": "Method", "type": "string" }, "initparams": { "title": "Initparams" }, "stateful": { "title": "Stateful", "type": "boolean" }, "serialized": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Serialized" } }, "required": [ "classname", "method", "initparams", "stateful" ], "title": "V1TransformModel", "type": "object" } } }
- Fields:
- field input: V1TransformJobInput | None = None
- field newsetname: str | None = None
- field success: bool | None = None
- pydantic model V1TransformModel
Bases:
BaseModelShow JSON schema
{ "title": "V1TransformModel", "type": "object", "properties": { "classname": { "title": "Classname", "type": "string" }, "columns": { "anyOf": [ {}, { "type": "null" } ], "default": null, "title": "Columns" }, "method": { "title": "Method", "type": "string" }, "initparams": { "title": "Initparams" }, "stateful": { "title": "Stateful", "type": "boolean" }, "serialized": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "title": "Serialized" } }, "required": [ "classname", "method", "initparams", "stateful" ] }
- Fields:
- field classname: str [Required]
- field columns: Any | None = None
- field initparams: Any [Required]
- field method: str [Required]
- field serialized: str | None = None
- field stateful: bool [Required]
- pydantic model V1TransformSplitArgs
Bases:
BaseModelShow JSON schema
{ "title": "V1TransformSplitArgs", "type": "object", "properties": { "train_size": { "title": "Train Size", "type": "number" }, "test_size": { "title": "Test Size", "type": "number" }, "validation_size": { "title": "Validation Size", "type": "number" } }, "required": [ "train_size", "test_size", "validation_size" ] }
- field test_size: float [Required]
- field train_size: float [Required]
- field validation_size: float [Required]
- pydantic model V1UploadSubmitJobResponse
Bases:
BaseModelShow JSON schema
{ "title": "V1UploadSubmitJobResponse", "type": "object", "properties": { "file_length": { "description": "File lenght.", "title": "File Length", "type": "integer" }, "job_submit_response": { "$ref": "#/$defs/V1JobModel", "description": "Job response." } }, "$defs": { "V1JobModel": { "properties": { "job_id": { "description": "The job id.", "title": "Job Id", "type": "string" }, "job_type": { "description": "The job type. Supported values: `dataloading`, `dataprofiling`, `driftdetection`, `modelperformance`, `preprocessing`.", "title": "Job Type", "type": "string" }, "user_id": { "description": "User id.", "title": "User Id", "type": "string" }, "run_id": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Run id.", "title": "Run Id" }, "status": { "description": "Job status. Supported values: `queued`, `done`.", "title": "Status", "type": "string" }, "statusdetails": { "description": "Status details.", "title": "Statusdetails", "type": "string" }, "result": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "Job results, if job status is `done`.", "title": "Result" }, "exception": { "description": "Exception details, if an exeption occurred while running the job.", "title": "Exception", "type": "string" }, "created": { "anyOf": [ { "format": "date-time", "type": "string" }, { "type": "null" } ], "default": null, "description": "The date and time the job pod was created.", "title": "Created" }, "started": { "description": "The date and time the job started.", "title": "Started", "type": "string" }, "finished": { "description": "The date and time the job finished.", "title": "Finished", "type": "string" }, "timestamp": { "description": "Job timestamp.", "title": "Timestamp", "type": "number" }, "configmap": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Configuration map.", "title": "Configmap" } }, "required": [ "job_id", "job_type", "user_id", "status", "statusdetails", "exception", "started", "finished", "timestamp" ], "title": "V1JobModel", "type": "object" } }, "required": [ "file_length", "job_submit_response" ] }
- field file_length: int [Required]
File lenght.
- field job_submit_response: V1JobModel [Required]
Job response.
vianops_client.models.jobmaker.model_artifacts
- pydantic model V1ModelRepoAddMetaJob
Bases:
BaseModelShow JSON schema
{ "title": "V1ModelRepoAddMetaJob", "type": "object", "properties": { "model_name": { "title": "Model Name", "type": "string" }, "model_version": { "title": "Model Version", "type": "string" }, "kind": { "title": "Kind", "type": "string" }, "data": { "anyOf": [ { "type": "object" }, { "type": "null" } ], "default": null, "title": "Data" } }, "required": [ "model_name", "model_version", "kind" ] }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field data: dict | None = None
- field kind: str [Required]
- field model_name: str [Required]
- field model_version: str [Required]
- pydantic model V1ModelRepoDeleteArtifactJob
Bases:
BaseModelShow JSON schema
{ "title": "V1ModelRepoDeleteArtifactJob", "type": "object", "properties": { "model_name": { "title": "Model Name", "type": "string" }, "model_version": { "title": "Model Version", "type": "string" }, "artifact_path": { "title": "Artifact Path", "type": "string" }, "run_id": { "title": "Run Id", "type": "string" } }, "required": [ "model_name", "model_version", "artifact_path", "run_id" ] }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field artifact_path: str [Required]
- field model_name: str [Required]
- field model_version: str [Required]
- field run_id: str [Required]
- pydantic model V1ModelRepoGetMetaJob
Bases:
BaseModelShow JSON schema
{ "title": "V1ModelRepoGetMetaJob", "type": "object", "properties": { "model_name": { "title": "Model Name", "type": "string" }, "model_version": { "title": "Model Version", "type": "string" } }, "required": [ "model_name", "model_version" ] }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field model_name: str [Required]
- field model_version: str [Required]
vianops_client.models.jobmaker.model_deployment
- pydantic model V1ModelDetails
Bases:
BaseModelShow JSON schema
{ "title": "V1ModelDetails", "type": "object", "properties": { "model_version": { "description": "Version of the placeholder model to deploy.", "title": "Model Version", "type": "string" }, "registered_model_version": { "description": "Version of registered model.", "title": "Registered Model Version", "type": "string" } }, "required": [ "model_version", "registered_model_version" ] }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field model_version: str [Required]
Version of the placeholder model to deploy.
- field registered_model_version: str [Required]
Version of registered model.
- pydantic model V1PlaceholderDeployment
Bases:
BaseModelShow JSON schema
{ "title": "V1PlaceholderDeployment", "type": "object", "properties": { "deployment_name": { "description": "Name of the model for this placeholder deployment.", "title": "Deployment Name", "type": "string" }, "model_name": { "description": "Name of the model for this placeholder deployment. Model name and deployment name are the same. (The endpoint replaces this name with the deployment name.)", "title": "Model Name", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Version of the model to use in the placeholder deployment.", "title": "Model Version" }, "model_details": { "description": "Model details.", "items": { "$ref": "#/$defs/V1ModelDetails" }, "title": "Model Details", "type": "array" }, "featureset": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of the feature set associated with the deployment.", "title": "Featureset" }, "training_params": { "anyOf": [ { "$ref": "#/$defs/V1TrainingParams" }, { "type": "null" } ], "default": null, "description": "Model training data and meta data" } }, "$defs": { "V1ModelDetails": { "properties": { "model_version": { "description": "Version of the placeholder model to deploy.", "title": "Model Version", "type": "string" }, "registered_model_version": { "description": "Version of registered model.", "title": "Registered Model Version", "type": "string" } }, "required": [ "model_version", "registered_model_version" ], "title": "V1ModelDetails", "type": "object" }, "V1TrainingParams": { "properties": { "model_class": { "default": "sklearn", "description": "Class of model (or framework) used to train the experiment. Default value: `sklearn`", "title": "Model Class", "type": "string" }, "model_name": { "description": "Name of model.", "title": "Model Name", "type": "string" }, "experiment_type": { "description": "Type of prediction problem for the experiment. Supported values: `regression` or `classification`.", "title": "Experiment Type", "type": "string" }, "featureset": { "description": "Name of the feature set used to train the experiment.", "title": "Featureset", "type": "string" }, "allcolumns": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of all columns in the training feature set. Includes the target column.", "title": "Allcolumns" }, "continuouscolumns": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of columns containing continuous data in the training feature set, if any. (Typically, these are numerical columns with integer or float data types.) Include target column if applicable. Leave empty brackets [] if there are no continuous columns.", "title": "Continuouscolumns" }, "categoricalcolumns": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of all columns containing categorical data in the training feature set, if any. Include target column if applicable. Leave empty brackets [] if there are no categorical columns.", "title": "Categoricalcolumns" }, "targetcolumn": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of the feature (column) the model is predicting.", "title": "Targetcolumn" } }, "required": [ "model_name", "experiment_type", "featureset" ], "title": "V1TrainingParams", "type": "object" } }, "example": { "deployment_name": "string", "featureset": "string", "model_details": [ { "model_version": "string", "registered_model_version": "string" } ], "model_name": "string", "model_version": "1", "training_params": { "allcolumns": [ "column1", "column2", "column3", "column4", "column5" ], "categoricalcolumns": [ "column3", "column4" ], "continuouscolumns": [ "column1", "column2", "column5" ], "experiment_type": "regression", "featureset": "string", "model_class": "catboost", "model_name": "catboost.CatBoostRegressor", "targetcolumn": "column2" } }, "required": [ "deployment_name", "model_name", "model_details" ] }
- Config:
protected_namespaces: tuple = ()
json_schema_extra: dict = {‘example’: {‘deployment_name’: ‘string’, ‘model_name’: ‘string’, ‘model_version’: ‘1’, ‘model_details’: [{‘model_version’: ‘string’, ‘registered_model_version’: ‘string’}], ‘featureset’: ‘string’, ‘training_params’: {‘model_class’: ‘catboost’, ‘model_name’: ‘catboost.CatBoostRegressor’, ‘experiment_type’: ‘regression’, ‘featureset’: ‘string’, ‘allcolumns’: [‘column1’, ‘column2’, ‘column3’, ‘column4’, ‘column5’], ‘continuouscolumns’: [‘column1’, ‘column2’, ‘column5’], ‘categoricalcolumns’: [‘column3’, ‘column4’], ‘targetcolumn’: ‘column2’}}}
- Fields:
- Validators:
- field deployment_name: str [Required]
Name of the model for this placeholder deployment.
- field featureset: str | None = None
Name of the feature set associated with the deployment.
- field model_details: List[V1ModelDetails] [Required]
Model details.
- field model_name: str [Required]
Name of the model for this placeholder deployment. Model name and deployment name are the same. (The endpoint replaces this name with the deployment name.)
- Validated by:
- field model_version: str | None = None
Version of the model to use in the placeholder deployment.
- field training_params: V1TrainingParams | None = None
Model training data and meta data
- validator grouped_filters_validator » model_name
- pydantic model V1TrainingParams
Bases:
BaseModelShow JSON schema
{ "title": "V1TrainingParams", "type": "object", "properties": { "model_class": { "default": "sklearn", "description": "Class of model (or framework) used to train the experiment. Default value: `sklearn`", "title": "Model Class", "type": "string" }, "model_name": { "description": "Name of model.", "title": "Model Name", "type": "string" }, "experiment_type": { "description": "Type of prediction problem for the experiment. Supported values: `regression` or `classification`.", "title": "Experiment Type", "type": "string" }, "featureset": { "description": "Name of the feature set used to train the experiment.", "title": "Featureset", "type": "string" }, "allcolumns": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of all columns in the training feature set. Includes the target column.", "title": "Allcolumns" }, "continuouscolumns": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of columns containing continuous data in the training feature set, if any. (Typically, these are numerical columns with integer or float data types.) Include target column if applicable. Leave empty brackets [] if there are no continuous columns.", "title": "Continuouscolumns" }, "categoricalcolumns": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": null, "description": "List of all columns containing categorical data in the training feature set, if any. Include target column if applicable. Leave empty brackets [] if there are no categorical columns.", "title": "Categoricalcolumns" }, "targetcolumn": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of the feature (column) the model is predicting.", "title": "Targetcolumn" } }, "required": [ "model_name", "experiment_type", "featureset" ] }
- Config:
protected_namespaces: tuple = ()
- Fields:
- field allcolumns: List[str] | None = None
List of all columns in the training feature set. Includes the target column.
- field categoricalcolumns: List[str] | None = None
List of all columns containing categorical data in the training feature set, if any. Include target column if applicable. Leave empty brackets [] if there are no categorical columns.
- field continuouscolumns: List[str] | None = None
List of columns containing continuous data in the training feature set, if any. (Typically, these are numerical columns with integer or float data types.) Include target column if applicable. Leave empty brackets [] if there are no continuous columns.
- field experiment_type: str [Required]
Type of prediction problem for the experiment. Supported values: regression or classification.
- field featureset: str [Required]
Name of the feature set used to train the experiment.
- field model_class: str = 'sklearn'
Class of model (or framework) used to train the experiment. Default value: sklearn
- field model_name: str [Required]
Name of model.
- field targetcolumn: str | None = None
Name of the feature (column) the model is predicting.
vianops_client.models.jobmaker.modelperformance
- pydantic model V1ModelPerformanceJob
Bases:
BaseModelShow JSON schema
{ "title": "V1ModelPerformanceJob", "type": "object", "properties": { "deployment_name": { "description": "The name of the deployment.", "title": "Deployment Name", "type": "string" }, "model_name": { "description": "The name of the model.", "title": "Model Name", "type": "string" }, "job_type": { "const": "modelperformance", "default": "modelperformance", "description": "Supports the model performance job.", "title": "Job Type", "type": "string" }, "model_version": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The version of the model, e.g., 1.", "title": "Model Version" }, "model_stage": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The stage of the model, e.g., primary.", "title": "Model Stage" }, "job_description": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "Parameters passed to the model performance job. For example, \"job_description\":{\"deployment_name\":\"deployment_xyz\",\"deployment_type\":\"vianai-v2\"}}", "title": "Job Description" }, "method": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "preprocess", "description": "The model performance method. Supported values: `LLM`, `preprocess` (the default value),.", "title": "Method" }, "joined_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The merged table with inference data and ground truth data on qna io uuid.", "title": "Joined Table" }, "task_type": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Differentiates between LLM monitoring and benchmarking model performance. Supported values: `benchmarking`, `monitoring`.", "title": "Task Type" }, "im_index": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Inference mapping index associated with model.", "title": "Im Index" } }, "example": { "deployment_name": "deployment_xyz", "job_description": { "deployment_name": "deployment_xyz", "deployment_type": "vianai-v2" }, "job_type": "modelperformance", "method": "preprocess", "model_name": "vianai.model_name", "model_stage": "primary", "model_version": "1" }, "required": [ "deployment_name", "model_name" ] }
- Config:
protected_namespaces: tuple = ()
json_schema_extra: dict = {‘example’: {‘deployment_name’: ‘deployment_xyz’, ‘model_name’: ‘vianai.model_name’, ‘model_version’: ‘1’, ‘job_type’: ‘modelperformance’, ‘model_stage’: ‘primary’, ‘job_description’: {‘deployment_name’: ‘deployment_xyz’, ‘deployment_type’: ‘vianai-v2’}, ‘method’: ‘preprocess’}}
- Fields:
- field deployment_name: str [Required]
The name of the deployment.
- field im_index: int | None = None
Inference mapping index associated with model.
- field job_description: Any | None = None
Parameters passed to the model performance job. For example, “job_description”:{“deployment_name”:”deployment_xyz”,”deployment_type”:”vianai-v2”}}
- field job_type: Literal['modelperformance'] = 'modelperformance'
Supports the model performance job.
- field joined_table: str | None = None
The merged table with inference data and ground truth data on qna io uuid.
- field method: str | None = 'preprocess'
The model performance method. Supported values: LLM, preprocess (the default value),.
- field model_name: str [Required]
The name of the model.
- field model_stage: str | None = None
The stage of the model, e.g., primary.
- field model_version: str | None = None
The version of the model, e.g., 1.
- field task_type: str | None = None
Differentiates between LLM monitoring and benchmarking model performance. Supported values: benchmarking, monitoring.
vianops_client.models.jobmaker.preprocessing
- pydantic model V1PreprocessingJob
Bases:
BaseModelShow JSON schema
{ "title": "V1PreprocessingJob", "type": "object", "properties": { "inference_mapping": { "$ref": "#/$defs/V1InferenceMappingModel" }, "process_window": { "anyOf": [ { "$ref": "#/$defs/V1PreprocessingProcessWindow" }, { "type": "null" } ], "default": null }, "job_type": { "const": "preprocessing", "default": "preprocessing", "title": "Job Type", "type": "string" }, "method": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "preprocess", "title": "Method" }, "refresh": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "title": "Refresh" } }, "$defs": { "V1InferenceMappingColumnSchema": { "properties": { "feature_id": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Id of the feature, generated by the platform for optimization.", "title": "Feature Id" }, "name": { "description": "Name of column.", "title": "Name", "type": "string" }, "dtype": { "description": "Data type of column. For example, `float64`.", "title": "Dtype", "type": "string" }, "sql_type": { "description": "SQL data type of column. For example, `Float32`.", "title": "Sql Type", "type": "string" }, "feature_type": { "description": "Feature type of column. Acceptable values include `categorical` and `continuous`.", "title": "Feature Type", "type": "string" }, "segmentation": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": true, "description": "If true (the default), the column is enabled for segmentation calculations.", "title": "Segmentation" }, "drift": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": true, "description": "If true (the default), the column is enabled for drift calculations.", "title": "Drift" }, "hotspot": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "If true (the default), the column is enabled for hotspot analysis.", "title": "Hotspot" }, "rca": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "List of column names included for root cause analysis (rca). Set by the platform based on feature configuration to identify features available for hotspot analysis.", "title": "Rca" }, "round": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The number of decimals to round to on a continuous float column.", "title": "Round" } }, "required": [ "name", "dtype", "sql_type", "feature_type" ], "title": "V1InferenceMappingColumnSchema", "type": "object" }, "V1InferenceMappingModel": { "example": { "connection": "Internal clickhouse DB", "create_ddl": null, "deployment": "vianai.jt_placeholder_deployment", "df_schema": { "columns": [ { "drift": true, "dtype": "float64", "feature_id": 1, "feature_type": "categorical", "name": "PULocationID", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 2, "feature_type": "categorical", "name": "DOLocationID", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 3, "feature_type": "continuous", "name": "trip_distance", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 4, "feature_type": "continuous", "name": "travel_time", "segmentation": true, "sql_type": "Float32" }, { "drift": false, "dtype": "datetime64[ns]", "feature_id": 5, "feature_type": "unknown", "name": "PUdatetime", "sql_type": "" } ], "datetime_col": "PUdatetime", "identifier_cols": [ "pk" ], "target_col": "total_amount" }, "ground_truth_table": "16794179557100_gt", "identifier_cols_schema": null, "index": 7, "inference_table": "16794179557100_dit", "joined_table": "16794179557100_joined", "key_table": "16794179557100_key", "model_name": "vianai.jt_placeholder_deployment", "model_stage": "primary", "model_version": "1", "postprocessors": [ { "classname": "vianai.postprocessing.classification.PickInferenceMapper", "initparams": { "mapper": "{1:'a',2:'b',3:'c'}" }, "method": "fit_transform" } ] }, "properties": { "index": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Index identifier.", "title": "Index" }, "deployment": { "description": "Deployment name for the related model.", "title": "Deployment", "type": "string" }, "model_name": { "description": "Model name for the related model.", "title": "Model Name", "type": "string" }, "model_version": { "description": "Model version for the related model, e.g., 1.", "title": "Model Version", "type": "string" }, "model_stage": { "description": "Model stage for the related model, e.g., primary.", "title": "Model Stage", "type": "string" }, "connection": { "description": "Database connection for the inference mapping.", "title": "Connection", "type": "string" }, "df_schema": { "$ref": "#/$defs/V1InferenceMappingSchema", "description": "Dictionary containing dataframe schema for model, i.e., target column, identifier column(s), all columns, datetime column, and predict probability column (classification models only)." }, "identifier_cols_schema": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "List containing identifier columns schema for model.", "title": "Identifier Cols Schema" }, "inference_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of inference table for mapping.", "title": "Inference Table" }, "ground_truth_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of ground truth table for mapping.", "title": "Ground Truth Table" }, "joined_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of joined table for mapping.", "title": "Joined Table" }, "key_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of key table for mapping.", "title": "Key Table" }, "create_ddl": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The query to create the ddl tables.", "title": "Create Ddl" }, "postprocessors": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "One or more postprocessor (and related params) to include in inference mapping, to transform output data before sending to backend database. The available postprocessors include `PickHighestProbability`, `PickInferenceMapper`, and `PickProbablityThreshold`. For each postprocessor, specify the classname, method, and initparams.", "title": "Postprocessors" }, "training_set_id": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Training set id that needs to be specified for training data preprocessing.", "title": "Training Set Id" }, "training_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Training table name that needs to be specified for training data preprocessing.", "title": "Training Table" } }, "required": [ "deployment", "model_name", "model_version", "model_stage", "connection", "df_schema" ], "title": "V1InferenceMappingModel", "type": "object" }, "V1InferenceMappingSchema": { "properties": { "target_col": { "description": "Name of target column.", "title": "Target Col", "type": "string" }, "identifier_cols": { "default": [], "description": "List of identifier columns.", "items": { "type": "string" }, "title": "Identifier Cols", "type": "array" }, "columns": { "description": "List of all columns.", "items": { "$ref": "#/$defs/V1InferenceMappingColumnSchema" }, "title": "Columns", "type": "array" }, "datetime_col": { "default": "", "description": "Name of datetime column", "title": "Datetime Col", "type": "string" }, "predict_proba_col": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "(Classification models only) Name of column that provides the predict probability.", "title": "Predict Proba Col" } }, "required": [ "target_col", "columns" ], "title": "V1InferenceMappingSchema", "type": "object" }, "V1PreprocessingProcessWindow": { "example": { "end_date": "2023-03-16", "start_date": "2023-02-07" }, "properties": { "start_date": { "default": null, "description": "Start date in string for process window (in string format), formatted as yyy-mm-dd.", "title": "Start Date", "type": "string" }, "end_date": { "default": null, "description": "End date in string for process window (in string format), formatted as yyy-mm-dd.", "title": "End Date", "type": "string" } }, "title": "V1PreprocessingProcessWindow", "type": "object" } }, "required": [ "inference_mapping" ] }
- Fields:
- field inference_mapping: V1InferenceMappingModel [Required]
- field job_type: Literal['preprocessing'] = 'preprocessing'
- field method: str | None = 'preprocess'
- field process_window: V1PreprocessingProcessWindow | None = None
- field refresh: bool | None = False
- pydantic model V1PreprocessingJoinJob
Bases:
BaseModelShow JSON schema
{ "title": "V1PreprocessingJoinJob", "type": "object", "properties": { "inference_mapping": { "$ref": "#/$defs/V1InferenceMappingModel" }, "process_window": { "anyOf": [ { "$ref": "#/$defs/V1PreprocessingJoinProcessWindow" }, { "type": "null" } ], "default": null }, "method": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "join", "title": "Method" }, "job_type": { "const": "join_preprocessing", "default": "join_preprocessing", "title": "Job Type", "type": "string" } }, "$defs": { "V1InferenceMappingColumnSchema": { "properties": { "feature_id": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Id of the feature, generated by the platform for optimization.", "title": "Feature Id" }, "name": { "description": "Name of column.", "title": "Name", "type": "string" }, "dtype": { "description": "Data type of column. For example, `float64`.", "title": "Dtype", "type": "string" }, "sql_type": { "description": "SQL data type of column. For example, `Float32`.", "title": "Sql Type", "type": "string" }, "feature_type": { "description": "Feature type of column. Acceptable values include `categorical` and `continuous`.", "title": "Feature Type", "type": "string" }, "segmentation": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": true, "description": "If true (the default), the column is enabled for segmentation calculations.", "title": "Segmentation" }, "drift": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": true, "description": "If true (the default), the column is enabled for drift calculations.", "title": "Drift" }, "hotspot": { "anyOf": [ { "type": "boolean" }, { "type": "null" } ], "default": false, "description": "If true (the default), the column is enabled for hotspot analysis.", "title": "Hotspot" }, "rca": { "anyOf": [ { "items": { "type": "string" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "List of column names included for root cause analysis (rca). Set by the platform based on feature configuration to identify features available for hotspot analysis.", "title": "Rca" }, "round": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "The number of decimals to round to on a continuous float column.", "title": "Round" } }, "required": [ "name", "dtype", "sql_type", "feature_type" ], "title": "V1InferenceMappingColumnSchema", "type": "object" }, "V1InferenceMappingModel": { "example": { "connection": "Internal clickhouse DB", "create_ddl": null, "deployment": "vianai.jt_placeholder_deployment", "df_schema": { "columns": [ { "drift": true, "dtype": "float64", "feature_id": 1, "feature_type": "categorical", "name": "PULocationID", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 2, "feature_type": "categorical", "name": "DOLocationID", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 3, "feature_type": "continuous", "name": "trip_distance", "segmentation": true, "sql_type": "Float32" }, { "drift": true, "dtype": "float64", "feature_id": 4, "feature_type": "continuous", "name": "travel_time", "segmentation": true, "sql_type": "Float32" }, { "drift": false, "dtype": "datetime64[ns]", "feature_id": 5, "feature_type": "unknown", "name": "PUdatetime", "sql_type": "" } ], "datetime_col": "PUdatetime", "identifier_cols": [ "pk" ], "target_col": "total_amount" }, "ground_truth_table": "16794179557100_gt", "identifier_cols_schema": null, "index": 7, "inference_table": "16794179557100_dit", "joined_table": "16794179557100_joined", "key_table": "16794179557100_key", "model_name": "vianai.jt_placeholder_deployment", "model_stage": "primary", "model_version": "1", "postprocessors": [ { "classname": "vianai.postprocessing.classification.PickInferenceMapper", "initparams": { "mapper": "{1:'a',2:'b',3:'c'}" }, "method": "fit_transform" } ] }, "properties": { "index": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Index identifier.", "title": "Index" }, "deployment": { "description": "Deployment name for the related model.", "title": "Deployment", "type": "string" }, "model_name": { "description": "Model name for the related model.", "title": "Model Name", "type": "string" }, "model_version": { "description": "Model version for the related model, e.g., 1.", "title": "Model Version", "type": "string" }, "model_stage": { "description": "Model stage for the related model, e.g., primary.", "title": "Model Stage", "type": "string" }, "connection": { "description": "Database connection for the inference mapping.", "title": "Connection", "type": "string" }, "df_schema": { "$ref": "#/$defs/V1InferenceMappingSchema", "description": "Dictionary containing dataframe schema for model, i.e., target column, identifier column(s), all columns, datetime column, and predict probability column (classification models only)." }, "identifier_cols_schema": { "anyOf": [ {}, { "type": "null" } ], "default": null, "description": "List containing identifier columns schema for model.", "title": "Identifier Cols Schema" }, "inference_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of inference table for mapping.", "title": "Inference Table" }, "ground_truth_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of ground truth table for mapping.", "title": "Ground Truth Table" }, "joined_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of joined table for mapping.", "title": "Joined Table" }, "key_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Name of key table for mapping.", "title": "Key Table" }, "create_ddl": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "The query to create the ddl tables.", "title": "Create Ddl" }, "postprocessors": { "anyOf": [ { "items": { "type": "object" }, "type": "array" }, { "type": "null" } ], "default": [], "description": "One or more postprocessor (and related params) to include in inference mapping, to transform output data before sending to backend database. The available postprocessors include `PickHighestProbability`, `PickInferenceMapper`, and `PickProbablityThreshold`. For each postprocessor, specify the classname, method, and initparams.", "title": "Postprocessors" }, "training_set_id": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Training set id that needs to be specified for training data preprocessing.", "title": "Training Set Id" }, "training_table": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "Training table name that needs to be specified for training data preprocessing.", "title": "Training Table" } }, "required": [ "deployment", "model_name", "model_version", "model_stage", "connection", "df_schema" ], "title": "V1InferenceMappingModel", "type": "object" }, "V1InferenceMappingSchema": { "properties": { "target_col": { "description": "Name of target column.", "title": "Target Col", "type": "string" }, "identifier_cols": { "default": [], "description": "List of identifier columns.", "items": { "type": "string" }, "title": "Identifier Cols", "type": "array" }, "columns": { "description": "List of all columns.", "items": { "$ref": "#/$defs/V1InferenceMappingColumnSchema" }, "title": "Columns", "type": "array" }, "datetime_col": { "default": "", "description": "Name of datetime column", "title": "Datetime Col", "type": "string" }, "predict_proba_col": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": null, "description": "(Classification models only) Name of column that provides the predict probability.", "title": "Predict Proba Col" } }, "required": [ "target_col", "columns" ], "title": "V1InferenceMappingSchema", "type": "object" }, "V1PreprocessingJoinProcessWindow": { "example": { "batch_size": 60, "end_time": "2023-03-21 18:00:00", "start_time": "2023-03-21 11:00:00" }, "properties": { "start_time": { "default": null, "description": "tart time for process window (in string format), with method join.", "title": "Start Time", "type": "string" }, "end_time": { "default": null, "description": "End time for process window (in string format), with method join.", "title": "End Time", "type": "string" }, "batch_size": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Batch size for process window (in integer format) with method join.", "title": "Batch Size" } }, "title": "V1PreprocessingJoinProcessWindow", "type": "object" } }, "required": [ "inference_mapping" ] }
- Fields:
- field inference_mapping: V1InferenceMappingModel [Required]
- field job_type: Literal['join_preprocessing'] = 'join_preprocessing'
- field method: str | None = 'join'
- field process_window: V1PreprocessingJoinProcessWindow | None = None
- pydantic model V1PreprocessingJoinProcessWindow
Bases:
BaseModelShow JSON schema
{ "title": "V1PreprocessingJoinProcessWindow", "type": "object", "properties": { "start_time": { "default": null, "description": "tart time for process window (in string format), with method join.", "title": "Start Time", "type": "string" }, "end_time": { "default": null, "description": "End time for process window (in string format), with method join.", "title": "End Time", "type": "string" }, "batch_size": { "anyOf": [ { "type": "integer" }, { "type": "null" } ], "default": null, "description": "Batch size for process window (in integer format) with method join.", "title": "Batch Size" } }, "example": { "batch_size": 60, "end_time": "2023-03-21 18:00:00", "start_time": "2023-03-21 11:00:00" } }
- Config:
json_schema_extra: dict = {‘example’: {‘start_time’: ‘2023-03-21 11:00:00’, ‘end_time’: ‘2023-03-21 18:00:00’, ‘batch_size’: 60}}
- Fields:
- field batch_size: int | None = None
Batch size for process window (in integer format) with method join.
- field end_time: str = None
End time for process window (in string format), with method join.
- field start_time: str = None
tart time for process window (in string format), with method join.
- pydantic model V1PreprocessingProcessWindow
Bases:
BaseModelShow JSON schema
{ "title": "V1PreprocessingProcessWindow", "type": "object", "properties": { "start_date": { "default": null, "description": "Start date in string for process window (in string format), formatted as yyy-mm-dd.", "title": "Start Date", "type": "string" }, "end_date": { "default": null, "description": "End date in string for process window (in string format), formatted as yyy-mm-dd.", "title": "End Date", "type": "string" } }, "example": { "end_date": "2023-03-16", "start_date": "2023-02-07" } }
- Config:
json_schema_extra: dict = {‘example’: {‘start_date’: ‘2023-02-07’, ‘end_date’: ‘2023-03-16’}}
- Fields:
- field end_date: str = None
End date in string for process window (in string format), formatted as yyy-mm-dd.
- field start_date: str = None
Start date in string for process window (in string format), formatted as yyy-mm-dd.
- pydantic model V1PreprocessingTrainingJob
Bases:
BaseModelShow JSON schema
{ "title": "V1PreprocessingTrainingJob", "type": "object", "properties": { "method": { "anyOf": [ { "type": "string" }, { "type": "null" } ], "default": "training", "title": "Method" }, "job_type": { "const": "training_preprocessing", "default": "training_preprocessing", "title": "Job Type", "type": "string" } } }
- field job_type: Literal['training_preprocessing'] = 'training_preprocessing'
- field method: str | None = 'training'