27 个Jupyter Notebook的小提示与技巧

27 个Jupyter Notebook的小提示与技巧

1. Keyboard Shortcuts

Help > keyboard Shortcuts

Cmd + Shift + P

Ctrl + Shift + P

Esc + F

Esc + o

Shift + J

Shift + Down

Shift + K

Shift + Up

Shift + M

2. Pretty Display of Varibles

ast_note_iteractively

line1 = "this is from line 1"
line2 = "this is from line 2"

line1
line2

'this is from line 2'

from IPython.core.interactiveshell import InteractiveShell
InteractiveShell.ast_node_interactivity = "all"

line1
line2

'this is from line 1'

'this is from line 2'

~/.ipython/profile_default/ipython_config.py

c = get_config()
# Run all nodes interactively
c.InteractiveShell.ast_node_interactivity = "all"

3. Easy links to documentation

Help

?

?sum()

4. Plotting in notebooks

%matplotlib inline

%matplotlib notebook

5. Jupyter Magic Commands

%matplotlib inline

%lsmagic

Available line magics:
%alias  %alias_magic  %autocall  %automagic  %autosave  %bookmark  %cat  %cd  %clear  %colors  %config  %connect_info  %cp  %debug  %dhist  %dirs  %doctest_mode  %ed  %edit  %env  %gui  %hist  %history  %killbgscripts  %ldir  %less  %lf  %lk  %ll  %load  %load_ext  %loadpy  %logoff  %logon  %logstart  %logstate  %logstop  %ls  %lsmagic  %lx  %macro  %magic  %man  %matplotlib  %mkdir  %more  %mv  %notebook  %page  %pastebin  %pdb  %pdef  %pdoc  %pfile  %pinfo  %pinfo2  %popd  %pprint  %precision  %profile  %prun  %psearch  %psource  %pushd  %pwd  %pycat  %pylab  %qtconsole  %quickref  %recall  %rehashx  %reload_ext  %rep  %rerun  %reset  %reset_selective  %rm  %rmdir  %run  %save  %sc  %set_env  %store  %sx  %system  %tb  %time  %timeit  %unalias  %unload_ext  %who  %who_ls  %whos  %xdel  %xmode

Available cell magics:
%%!  %%HTML  %%SVG  %%bash  %%capture  %%debug  %%file  %%html  %%javascript  %%js  %%latex  %%perl  %%prun  %%pypy  %%python  %%python2  %%python3  %%ruby  %%script  %%sh  %%svg  %%sx  %%system  %%time  %%timeit  %%writefile

Automagic is ON, % prefix IS NOT needed for line magics.

6. Jupyter Magic - %env:Set Environment Variables

# 单独运行 %env 会列出所有环境变量

# 带参数的话则会设置该变量 比如 OMP_NUM_THREADS=4
%env OMP_NUM_THREADS=4

env: OMP_NUM_THREADS=4

7. Jupyter Magic - %run:Excute python code

%run

%run

# this will execute and show the output from
# all code cells of the specified notebook
%run ./LinearRegression.ipynb

Coefficients:
[ 938.23786125]
Residual sum of squares: 2548.07
Variance score: 0.47

8. Jupyter Magic - %load:Insert the code from an external script

9. Jupyter Magic - %store:Pass variables between notebooks

%store

10. Jupyter Magic - %who:List all variables of global scope.

%who

str

%who

FormatCode	 Image	 InteractiveShell	 datasets	 diabetes	 diabetes_X	 diabetes_X_test	 diabetes_X_train	 diabetes_y_test
diabetes_y_train	 display	 line1	 line2	 linear_model	 name	 names	 np	 numpy
os	 plt	 regr	 time	 x

11. Jupyter Magic - Timing

%%time

%timeit

%%time

%%time
import time
for _ in range(1000):
time.sleep(0.01)# sleep for 0.01 seconds

CPU times: user 196 ms, sys: 21.4 ms, total: 217 ms
Wall time: 11.6 s

%timeit

import numpy
%timeit numpy.random.normal(size=100)

The slowest run took 46.45 times longer than the fastest. This could mean that an intermediate result is being cached.
100000 loops, best of 3: 6.26 µs per loop

12. Jupyter Magic - %%writefile and %pycat:Export the contents of a cell/Show the contents of an external script

%%writefile

%pycat

13. Jupyter Magic - %prun:Show how much time your program spent in each function

%prun statement_name

%prun print('hello')

hello

14. Jupyter Magic - Debugging with %pdb

pdb

15. Suppress the output of a final function

%matplotlib inline
from matplotlib import pyplot as plt
import numpy
x = numpy.linspace(0, 1, 1000)**1.5

# Here you get the output of the function
plt.hist(x)

(array([ 216.,  126.,  106.,   95.,   87.,   81.,   77.,   73.,   71.,   68.]),
array([ 0. ,  0.1,  0.2,  0.3,  0.4,  0.5,  0.6,  0.7,  0.8,  0.9,  1. ]),
)

# By adding a semicolon at the end, the output is suppressed.
plt.hist(x);

16. Executing Shell Commands

!ls

!ls

JupyterNotebookTips.ipynb      LinearRegression.ipynb
JupyterNotebookTips.ipynb-meta LinearRegression.ipynb-meta

!pip list | grep pandas

pandas (0.18.1)

17. Using LaTeX for formulas

$$ P(A \mid B) = \frac{P(B \mid A) \, P(A)}{P(B)} $$

18. Run code from a different kernel in a notebooks

%%bash

%%HTML

%%python2

%%python3

%%ruby

%%perl

%%bash
for i in {1..5}
do
echo "$i"
done

1
2
3
4
5

19. Install other kernels for Jupyter

conda install -c r r-essentials

brew cask install r-gui

install.packages(c('repr', 'IRdisplay', 'crayon', 'pbdZMQ', 'devtools'))
devtools::install_github('IRkernel/IRkernel')
IRkernel::installspec()  # to register the kernel in the current R installation

20. Running R and Python in the same notebook

pip install rpy2

21. Writing functions in other languages

pip install cython fortran-magic

22. Multicursor support

Alt

23. Jupyter-contrib extensions

jupyter spell-checker

code-formatter

http://localhost:8888/nbextensions/

conda install -c conda-forge jupyter_contrib_nbextensions

24. Create a presentation from a Jupyter notebook

conda install -c damianavila82 rise

pip install RISE

jupyter-nbextension install rise --py --sys-prefix
jupyter-nbextension enable rise --py --sys-prefix

25. The Jupyter output system

import os
from IPython.display import display, Image
names = [f for f in os.listdir('../images/') if f.endswith('.png')]
for name in names[:5]:
display(Image('../images/' + name, width=100))

26. 'Big data' analysis

27. Sharing notebooks

File > Download as > HTML

File > Download as > PDF