Building, just because…
When Airbnb was scaling rapidly, they faced the problem of organizing complex data pipelines. To combat this and become a data-driven organization, Airbnb launched Apache Airflow in 2015, their custom-made open-source platform to manage complex workflows. In simple words, Apache Airflow is a platform where you can create, schedule, and monitor complex workflows using simple …
Want help making a Twitter bot with Tweepy? It’s actually pretty easy after you apply for a developer’s account and setup an app on Twitter’s side. You can do the application and setup here. My Computer Setup Python3 (Finally getting used to adding parentheses around my print statements ) macOS Getting your Environment Setup You …
I recently came across a situation where I had to to save an array of objects to a local device so that I could pull that info up later. My problem was that I had to change that array of objects into a string before saving it. Thus, I had to cast a string array …
So you got the ‘PYTHON’ IS NOT RECOGNIZED AS AN INTERNAL OR EXTERNAL COMMAND, OPERABLE PROGRAM OR BATCH FILE error on your windows machine when trying to set up a new workstation? Maybe you’re new to Python and this is your first error ever? Regardless, it’s cutting into valuable procrastination time so let’s get er’ …
Just make an Http call! So, I thought I’d write a quick article on using the Google Translate API in your Android app since most of the articles I found didn’t help. Article after article pointed me in the direction of this Java library which unfortunately conflicted with other dependencies in my application. I spent …
Buttons are one of the most important building blocks in any application. Thus, their implementation is a key milestone in learning any new language that deals with GUIs. The following should get you through making any View, Button, or Image respond to touch in Android Studio.
One of the first things we do when starting off a new application is get our background squared away. This article will cover how to add a background image to a NextJS app. My Setup Operating System = macOS Ventura Next.js v13.1.1 Setting Up Our Basic NextJS App Webstorm Sooo, I use Webstorm. So rather …
Why Might I need A Partition Expiration? Partition expirations can be leveraged for several use cases. Some countries have laws pertaining to how long PII can be held. Storage is very expensive, maybe your company wants to save some money? The list can and will go on. But it gets a little harder when the …
We’ll walk you through how to run Apache Airflow locally in Docker. The first chunk of this post will cover how to get Airflow standing, the second will go into some nuance and will answer several whys. My Setup MacOS Ventura M1 Chip Getting Airflow Standing Docker 1. Download Docker Desktop from this link. Make …
I’ve had numerous cases where I’ve needed to execute bash commands and return the results in Python for some additional manipulation. My most recent example involved me working with BigQuery schemas. Getting schemas from the CLI was easy peasy but I’m not the best at BASH programming so I naturally turned to something more familiar …
Hi! So, you need to install a wordpress theme using the CLI for a subsite? Maybe you’re using Cloud Formation to scale your deployment or something and need it done each time your cluster of EC2 scales horizontally? Regardless, there’s a flag for that! I kept this one short and to the point. This should …
So what happens if your code does not follow the Python rules? This article will be fairly short. Most of this will not depend on your version of Python. Tabbing/Spacing So what happens if you get your tab or spacing incorrect? Let’s give it a go. Often times the best way to figure something like …
Who Am I? So, what is red tape? But first a little bit of background about me. My names Carlos and I’m a data guy. I started off as an analyst with a smaller firm that sold non passenger car tires. Think wheelbarrow tires. Next came Michael Kors, a luxury fashion brand valued somewhere around …
We’ll be removing duplicate elements from an array in BigQuery in this post. Let’s set the stage. It’s a chilly night in the office and marketing reaches out asking for data. PANIK. But they’ve given you a general location of where that data is located. CALM. You do a quick select * of the table …
Let’s start off with saying that horizontally scaling a wordpress website is very easy to do but is kinda expensive. I’d say it’s about $100+ a month to leave this infra consistently standing in AWS. Most of the cost is in the DB and EC2 instances. So, beware of forgetting about infra you stand up …
So your Apache Airflow DAG is failing silently. Are you running an ETL on a huge dataset? This is a symptom of an Airflow instance without sufficient memory. Dig into your instances logs and you’ll probably see an evicted worker if your running your instance’s workers on Kubernetes. You’ll see similar logs wherever you run …