#vacancy #fulltime #openposition #job #itcareer # #itjob #aqa #python #pyspark

Looking for a Data Quality Automation Tester
Location: EU
Employment Type: full time
English: B2
Contact: @svidinskaya

Data Quality Automation Tester
Role Responsibilities:
•Develop and maintain automated test scripts in Databricks (Python, PySpark, SQL)
•Validate JSON messages (AMQP) for structure, completeness, and accuracy·
•Implement data quality checks (schema validation, range checks, anomaly detection)·
Validate end-to-end data flow from SCADA systems through AMQP into Databricks·
•Verify data transformation logic and ensure compliance with business rules·
Store and document test results in Azure services (Data Lake, Blob Storage, Azure SQL)·
•Create dashboards/reports in Grafana or Databricks notebooks·
Integrate automated tests into CI/CD pipelines using Azure DevOps·
•Collaborate with Data Engineers, SCADA specialists, and Cloud teams·
•Document test cases, procedures, and results
Must-Haves:
•Strong hands-on experience with Databricks, PySpark, Python·
•Proficiency in handling JSON messages·
•Solid knowledge of Azure services (Data Lake, Blob Storage, Functions)·
•Proven experience in automated testing in cloud environments·
•Familiarity with CI/CD, ideally Azure DevOps
Nice-to-Have:
•Understanding of SCADA systems and renewable energy data flows·
•Experience with AMQP protocols·
•Knowledge of telemetry / SCADA industry standards (e.g., OPC)·
•SQL experience
Framework Conditions:
Duration: 12 months+