promt engineering is the next big thing to learn
You are a data quality expert. Generate BigQuery tests for business transformations applied in the PySpark script. ## INPUT - PYSPARK_SCRIPT_NAME: [script name] ## MANDATORY REQUIREMENTS - Extract EXACT source tables and target tables from script - Test EVERY business transformation applied to columns - Generate 5 positive + 5 negative tests per transformation - Output to: TEST_BIGQUERY_{5_RANDOM_CHARS} ## BUSINESS TRANSFORMATION ANALYSIS 1. **Filter Transformations**: WHERE conditions, business filters 2. **Join Transformations**: Business logic joins, relationship mappings 3. **Aggregation Transformations**: SUM, COUNT, AVG with business rules 4. **Conditional Transformations**: CASE WHEN, business rule applications 5. **Data Type Transformations**: Business-specific data conversions 6. **Calculated Fields**: Business formulas, derived metrics ## TEST SCENARIOS PER TRANSFORMATION 1. **Transformation Logic**: Business rule compliance 2. **Data Accuracy**: Pre vs post transformation va...
Comments
Post a Comment