Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG - KubeFlow local runner parameter type #7580

Closed
dabasmoti opened this issue May 19, 2024 · 2 comments
Closed

BUG - KubeFlow local runner parameter type #7580

dabasmoti opened this issue May 19, 2024 · 2 comments

Comments

@dabasmoti
Copy link

I am using SubProcess local runner and send parameter to the components
The Bigquery query send with
where n_articles >={{channel:task=;name=user_min_articles;type=Integer;}}

but the components gets
where n_articles >=20.0
Here is the Pipeline constructor:

@dsl.pipeline(name=f"{os.environ.get('MODEL_NAME','UNDEFINED')}-{os.environ.get('ENV','UNDEFINED')}")
def als_pipeline(
    bigquery_project_id: str = os.environ.get("BIGQUERY_PROJECT_ID"),
    dataset_id: str = "Recommendations",
    dataset_location: str = "EU",
    table_name: str = "train_data",
    training_files_destination: str = "gs://XXX/prod/als/train_data",
    user_min_articles: int = 5,
    user_max_articles: int = 1000,
):

Here is the component constructor:

@component(
    base_image="python:3.8",
    packages_to_install=[
        "google-cloud-bigquery==2.30.0",
        "google-cloud-storage==2.13.0",
        "pytz==2023.3"
        ],
)
def extract_bq_to_dataset(
    bq_client_project_id: str,
    source_project_id: str,
    dataset_id: str,
    table_name: str,
    dataset: Output[Dataset],
    destination_gcs_uri: str = None,
    dataset_location: str = "EU",
    extract_job_config: dict = None,
    clean_exists: bool = True,
    sequiential_queries: list = None,
    startup_query: str = None,
):
@kubeflow-bot kubeflow-bot added this to To Do in Needs Triage May 19, 2024
@juliusvonkohout
Copy link
Member

Wrong repository, report in kubeflow/pipelines

/close

Copy link

@juliusvonkohout: Closing this issue.

In response to this:

Wrong repository, report in kubeflow/pipelines

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants