12 Data Engineering Online Courses

According to Statista, by 2025 the big data market will grow to 175 zetabytes compared to 41 in 2019 (schedule) To get work in this area, you need to understand how to work with big data stored in the cloud. Cloud4Y has compiled a list of 12 paid and free data engineering courses that will expand your knowledge in this area and can be a good starting point on the path to cloud certifications.

Foreword

What is a data engineer? This is the person who is responsible for creating and maintaining the data architecture in the Data Science project. His responsibilities may include ensuring an uninterrupted data flow between the server and the application, integrating new software for data management, improving the underlying data processes and creating data pipelines.

There are a huge number of technologies and tools that a data engineer must possess in order to work with cloud computing, data warehousing, ETL (extraction, transformation, loading), etc. Moreover, the number of required skills is constantly growing, so a data engineer needs to regularly replenish his luggage knowledge. Our list has courses for beginners and experienced professionals. Choose what is right for you.

1. Data Engineering Nanodegree Certification (Udacity)

You will learn how to design data models, create data warehouses and data lakes, automate data pipelines and work with dataset arrays. At the end of the program, you test your new skills by completing the Capstone project.

Duration: 5 months, 5 hours a week
Tongue: English
Price: $ 1695
Level: initial

2. Become a Data Engineer Certification (Coursera)

Learn from the basics. You can develop in stages using lectures and practical projects to work on your skills. By the end of the training, you will be ready to work with ML and big data. It is recommended that you know Python at least at the minimum level.

Duration: 8 months, 10 hours a week
Tongue: English
Price: $ 115,000
Level: initial

3. Become a Data Engineer: Mastering the Concepts (LinkedIn Learning)

You will develop data design skills and DevOps skills, learn how to create Big Data applications, create data pipelines, process applications in real time using Hazelcast and a database Hadoop.

Duration: it depends on you
Tongue: English
Price: first month – free
Level: initial

4. Data Engineering Courses (edX)

Here is a series of programs that introduce you to data engineering and teach you how to develop analytical solutions. Courses are categorized according to level of difficulty, so you can choose one according to your level of experience. During the training process, you will learn how to use Spark, Hadoop, Azure and manage corporate data.

Duration: it depends on you
Tongue: English
Price: depends on the chosen course
Level: beginner, intermediate, advanced

5. Data Engineer (Dataquest)

You should choose this course if you have experience working with Python and want to deepen your knowledge and build a career as a data processing specialist. You will learn how to build data pipelines using Python and pandas, load large datasets into a Postgres database after cleaning, converting and validating.

Duration: it depends on you
Tongue: English
Price: depends on the subscription form
Level: beginner, middle

6. Data Engineering with Google Cloud (Coursera)

This course will help you acquire the skills you need to build a career in Big Data. For example, working with BigQuery, Spark. You’ll get the knowledge you need to prepare for industry-recognized Google Cloud Professional Data Engineer certification.

Duration: 4 months
Tongue: English
Price: while free
Level: beginner, middle

7. Data Engineering, Big Data on Google Cloud Platform (Coursera)

An interesting course that gives practical knowledge about data processing systems in GCP. During the lessons, you will learn how to design systems before you begin the development process. In addition, you will also analyze both structured and unstructured data, apply automatic scaling, and apply ML methods to extract information.

Duration: 3 months
Tongue: English
Price: while free
Level: beginner, middle

8. UC San Diego: Big Data Specialization (Coursera)

The course is based on the use of the Hadoop and Spark infrastructure and the application of these big data processing methods in the ML process. You will learn the basics of using Hadoop with MapReduce, Spark, Pig, and Hive. Learn how to build predictive models and use graph analytics to model problems. Note that this course does not require programming experience.

Duration: 8 months, 10 hours a week
Tongue: English
Price: while free
Level: initial

9. Taming Big Data With Apache Spark and Python (Udemy)

You’ll learn how to use the stream structure and data frames in Spark3, get an idea of ​​how to use Amazon’s Elastic MapReduce service to work with your cluster in Hadoop. Learn how to identify problems when analyzing big data and understand how GraphX ​​libraries work with network analysis and how you can use MLlib.

Duration: it depends on you
Tongue: English
Price: from 800 rubles to $ 149.99 (how lucky)
Level: beginner, middle

10. PG Program in Big Data Engineering (upGrad)

This course will give you an idea of ​​how Aadhaar works, how Facebook personalizes the feed, and how Data Engineering can be used. Key topics will be data processing (including real-time processing), MapReduce, big data analytics.

Duration: 11 months
Tongue: English
Price: around $ 3000
Level: initial

11. Profession Data Scientist (Skillbox)

You will learn how to program in Python, learn the frameworks for training neural networks Tensorflow and Keras. Master the MongoDB, PostgreSQL, SQLite3 databases, learn how to work with the Pandas, NumPy and Matpotlib libraries.

Duration: 300 hours of training
Tongue: Russian
Price: the first six months for free, then 3900 rubles a month
Level: initial

12. Data Engineer 7.0 (New professions lab)

You will have a deep study of Kafka, HDFS, ClickHouse, Spark, Airflow, lambda architecture and kappa architecture. You will learn how to connect tools to each other, forming pipelines, getting a baseline solution. Learning requires a minimum knowledge of Python 3.

Duration: 21 lessons, 7 weeks
Tongue: Russian
Price: from 60,000 to 120,000 rubles
Level: initial

If you want to add another good course to the list, you can unsubscribe in the comments or in the PM. We will supplement the post.

What else is useful to read on the blog Cloud4y

→ What is the geometry of the universe?
→ Easter eggs on topographic maps of Switzerland
→ A simplified and very short history of the development of “clouds”
→ How the bank broke
→ Computer brands of the 90s, part 3, final

Subscribe to our Telegram-channel, so as not to miss another article. We write no more than twice a week and only on business. We also remind that on May 21 at 15:00 (Moscow time) we will spend webinar on the topic “Information security of business when working on a remote site.” If you want to understand how to protect sensitive and corporate information when employees work from home – register!