Not logged in

Data Transformation Portal

Sign in

Cognizant

Data Transformation Agents

Data Pipeline - Silver to Gold / Data Product

Data Discovery

Access the Data Discovery application:

Open Data Discovery App

Data Ingestion Code Generation

Ingest To Landing Area

Accepted: .sql, .ddl, .txt (stored in approved/bronze_schema_ddl)

Agent Logs

Generated Code

silver_ingestion.py 
Code will appear here after generation...
Data Ingestion Code Generation Guidance

The ingestion code is generated and stored in Git (staging). Follow these steps to complete review & approval:

  1. Fetch the generated file from Git (staging branch) into your IDE.
  2. Review and optionally refine the code; commit changes back to staging.
  3. Use "Fetch and Preview Reviewed Code from Git" below to load the committed version.
  4. Approve it using "Approve the Code" to promote it forward.

Human Approval

Final Code Preview Before Approval

Data Ingestion Agent

Ingest To Landing Area (CSV)

Agent Logs

Business Rules to Configuration Agent

Fetch Metadata from Data Platform

Fetch the latest table and column metadata from data platform to ensure accurate case-sensitive names in YAML generation.

Upload STTM Excel File

Agent Logs

Generated YAML

silver_to_gold_transformation.yaml 
YAML will appear here after generation...
STTM Excel to YAML Guidance

The YAML is generated and placed in the staging branch. Complete your review using the following steps:

  1. Fetch the generated YAML locally from the staging branch.
  2. Review and adjust if needed; commit any updates.
  3. Load the committed version with "Fetch and Preview Reviewed Code from Git".
  4. Approve via "Approve The Code" to move it forward.

Human Approval (YAML)

Final Code Preview Before Approval

SQL Generator Agent

Generation Logs

Logs will appear here...

Generated SQL

generated_sql.sql 
SQL will appear here after generation...

Human-in-the-Loop: Edit SQL

Review and Edit Generated SQL

SQL Generation Workflow

Follow these steps to generate and review SQL:

  1. Click "Generate SQL" to create SQL statements from the transformation definitions.
  2. Review the generated SQL in the preview pane on the right.
  3. Click "Load SQL for Editing" to enable editing capabilities.
  4. Make any necessary modifications to the SQL in the editable text area.
  5. Click "Approve SQL" when ready to save the approved version.

Data Modelling

Coming soon...

Data Validation

Access the Data Validation application:

Open Data Validation App