Code for blog at https://www.startdataengineering.com/post/sql-v-python/.
Open this repo in your codespace by clicking on this link.
Wait for codespaces to setup environment with the requirements.txt file.
# run data transformations with
python src/native_python.py
python src/dataframe_python.py
python src/query.pyYour output will be the same. Run linting, tests as:
make ciPrerequisite:
- Python 3.11+
- git
Clone the repo, create a virtual env and run the code as shown below:
git clone https://github.com/josephmachado/python-v-sql-for-data-transform.git
cd python-v-sql-for-data-transform
python -m venv env
source env/bin/activate
pip install -r requirements.txt
# run data transformations with
python src/native_python.py
python src/dataframe_python.py
python src/query.pyYour output will be the same. Run linting, tests as:
make ci