Types of Jobs: – Parallel jobs, job sequences, and server jobs. Manager: – It is used to manage, browse, and edit the data warehouse repository.Used by DataStage support roles to monitor the jobs and fix job failures. Director: – This is used to monitor and manage the Datastage jobs.Designer: – Here designer is used to create Datastage jobs, job sequences which in turn are compiled into executable programs.Administrator: – Manages the global settings and interacts with systems.We design jobs for extraction, transformation, and loading in a sequential job manner or Parallel manner.ĭatastage usually has different components that would help us achieve the overall extraction, transformation, and load.For this need, we got the ETL batch processing system to deal with large volumes of data parallel. To overcome the above drawbacks, we needed batch processing that can be done parallelly. In the traditional batch, processing becomes impractical with big data volumes very complex to manage lots of small jobs needed to achieve the requirement. Disk to perform transformations and then save to disk.
