Azure Data Factory
The technology
Azure Data Factory is Microsoft Azure's data integration service: pipeline orchestration, connectors to application and cloud sources, transformations and scheduling.
Pipelines built in the interface quickly become hard to maintain. Scaling requires as-code deployment, separate environments and pipeline monitoring.
Engagements
Visian engagements on Azure Data Factory
- Design and development of ingestion pipelines
- As-code deployment (ARM, Bicep, Terraform) and CI/CD across environments
- Migration from Talend, SSIS or legacy scripts
- Monitoring, alerting and run-cost analysis
- Integration with Azure SQL, Synapse, Fabric or Databricks
These engagements are part of the Data platformexpertise, on a fixed-price, time-and-materials or service-centre basis.
References
Client cases
- Transavia · Airline, Data Engineering
Frequently asked questions
Azure Data Factory: FAQ
Azure Data Factory or Microsoft Fabric?
Fabric integrates Data Factory with OneLake storage and Power BI. For an already structured Azure estate, Data Factory alone remains relevant; for a new Microsoft foundation, Fabric simplifies the whole.
Can Talend flows be migrated to Azure Data Factory?
Yes. Migration starts with an inventory of flows and their rationalisation, followed by a batch rewrite with data regression tests.