# %% scripts are superior to Jupyter Notebooks

November 13, 2024•104 words

Jupyter notebooks, while popular as an entry to data science, have many shortcomings. The drawbacks and dangers of over-reliance on Jupyter notebooks are best summarized in this 2018 talk by Joel Grus.

The percent format for Python scripts, denoted by # %%, is a great way to replace Jupyter notebooks. The percent format is supported by many editors, most notably VS Code. The official guide offers intuitive examples as introduction to the percent format and allows for a smooth transition from notebooks to scripts.

I have been using # %% since 2021 after a brief few weeks in Jupyter notebooks and never looked back.

👍❤️🫶👏👌🤯🤔😂😍😭😢😡😮

Subscribe to the author

You'll only receive email when they publish something new.

More from Spark Tseung
All posts

venv for Python Virtual Environments

November 3, 2024•189 words

The venv library is part of the Python standard library suites for creating reproducible environments in terms of package dependencies. Suppose you have a folder for a Python project. The following command creates a new virtual environment. python -m venv /path/to/new/virtual/environment Then, use the following command to activate (or "enter") this virtual environment. source /path/to/new/virtual/environment/bin/activate Now we are working in an isolated Python environment: everything Python-...

Read post

Minimal Example for Python Multiprocessing

November 18, 2024•56 words

The following is a minimal example for multiprocessing in Python. A very useful guide written by Jan Bodnar is here. from multiprocessing import Process def fun(i): return i def main(): proc = [] for i in 1:100: p = Process(target=fun, args=(i, )) p.start() proc.append(p) for p in proc: p.join() if __name__ == '__main__': main() ...

Read post

# %% scripts are superior to Jupyter Notebooks

More from Spark TseungAll posts

venv for Python Virtual Environments

Minimal Example for Python Multiprocessing

More from Spark Tseung
All posts