A holistic component-based platform for automating Data Reconciliation tests in modern Data Lake and Cloud Data Migration projects using Apache Spark. Dataflow is a module within DataOps Suite designed to efficiently handle next-generation ETL or ELT processes. It complements ETL Validator and other modules within the DataOps Suite to provide one unified platform to streamline data-intensive operations. Built on patented architecture, it leverages Apache Spark as the underlying engine to move data from source to target systems. By leveraging simple UIs and wizard-based capabilities, Data Engineers, Testers & Business Analysts can streamline data-intensive operations. Management can save a tremendous amount of costs by leveraging Dataflow as it is open source and sufficient for most data migration projects. SQL: This is the only language required to automate flows using Dataflow. This brings down the total cost of ownership as SQL knowledge is a common skill in Engineering, Testing, and Business Analysis teams. If you choose to leverage Python or Scala, then, Dataflow has the provision to support your needs. Scheduling: At the scheduled time, Dataflow automatically executes the tests and emails summary reports to the right stakeholders.