Getting Started with Apache Airflow: A Beginner’s Guide

Post about Apache Airflow Or Data Engineering

When Airbnb was scaling rapidly, they faced the problem of organizing complex data pipelines. To combat this and become a data-driven organization, Airbnb launched Apache Airflow in 2015, their custom-made open-source platform to manage complex workflows. In simple words, Apache Airflow is a platform where you can create, schedule, and monitor complex workflows using simple … Read more

How to Upload a Pandas DataFrame to DynamoDB with Python

So you’re trying to upload a Pandas DataFrame to DynamoDB using Python? Let’s take a step back first. Why are we using DynamoDB? What is DynamoDB? What is DyanmoDB DyanmoDB is a non-relational fully managed database product offered by Amazon’s cloud computing arm AWS. So why would you go the DynamoDB route vs MySQL, Postgres, … Read more

Fix: IndexError – Only Integers, Slices, Ellipsis, and Boolean Arrays Are Valid Indices

Soooo you got the IndexError: only integers, slices (`:`), ellipsis (`…`), numpy.newaxis (`None`) and integer or boolean arrays are valid indices error. Let’s get that annoying message fixed. My Computer Setup For those Short On Time You’re trying to access an element of a Pandas index like df.columns where df is a DataFrame by using … Read more

How to Create a Class in Python 3 (With Examples)

So how do you create a class in Python3? What is class? Why do we need a class? All great questions. My Computer Setup Python3 (Finally getting used to adding parentheses around my print statements ) macOS What is an object? So let’s go over what a class is. Classes are the preliminary step to … Read more

How to Build a Twitter Bot with Tweepy in Python

Want help making a Twitter bot with Tweepy? It’s actually pretty easy after you apply for a developer’s account and setup an app on Twitter’s side. You can do the application and setup here. My Computer Setup Getting your Environment Setup You can find some info on installing pip here. The article actually covers pip installation … Read more

Exit mobile version