Model Converter

Many deep learning frameworks (i.e. TensorflowV1, PyTorch, Caffe..) provide convert tool that can convert models from different deep learning training frameworks into a format that can be deployed on IoT Yocto. Here we mean that NeuronSDK can only accept quantized Tensorflow-Lite model as input.

Converter tool handles the variations of both the operator definitions and model representations among different training frameworks, and provides device-independent optimizations to the given model. In this section, we provide some examples of using TensorFlow v2’s Converter Tool. TensorflowV2 Converter Tool is also capable of quantizing the model with different configurations, such as 8-bit asymmetric quantization, 16-bit symmetric quantization, or mixed-bit quantization. Post-training quantization can be applied during the conversion process if necessary.

We will also demonstrate how to use ncc-tflite to convert quantized model to DLA model.

Note

No matter what deep-learning-framework model (i.e. TensorflowV1, PyTorch, Caffe..) user chooses as source, as long as the converted model is a quantized Tensorflow-Lite model, it is the valid input of neuron SDK. Users need to have knowledge about the model conversion method of the corresponding framework, which will not be described in this section.

Note

TensorFlow is tested and supported on the following 64-bit systems:

  • Python 3.7–3.10

  • Ubuntu 16.04 or later

  • Windows 7 or later (with C++ redistributable),

  • macOS 10.12.6 (Sierra) or later (no GPU support)

  • WSL2 via Windows 10 19044 or higher including GPUs (Experimental).

Please refer Install Page for details.

Convert TensorFlow V2 Float Model to Quant Model

The following example is referenced from Tensorflow official website, please find the details in TensorFlow Post-training Integer Quantization. The reference for environment setup for running this test is shown in the Section: Testing Environment.

Model Preparation

First, train the float-point model based on the MNIST dataset .

# Load MNIST dataset
mnist = tf.keras.datasets.mnist
(train_images, train_labels), (test_images, test_labels) = mnist.load_data()

# Normalize the input image so that each pixel value is between 0 to 1.
train_images = train_images.astype(np.float32) / 255.0
test_images = test_images.astype(np.float32) / 255.0

# Define the model architecture
model = tf.keras.Sequential([
        tf.keras.layers.InputLayer(input_shape=(28, 28), batch_size=1),
                tf.keras.layers.Reshape(target_shape=(28, 28, 1)),
                tf.keras.layers.Conv2D(filters=12, kernel_size=(3, 3), activation='relu'),
                tf.keras.layers.MaxPooling2D(pool_size=(2, 2)),
                tf.keras.layers.Flatten(),
                tf.keras.layers.Dense(10)
])

# Train the digit classification model
model.compile(optimizer='adam',
        loss=tf.keras.losses.SparseCategoricalCrossentropy(from_logits=True),
                        metrics=['accuracy'])
model.fit(
        train_images,
        train_labels,
        epochs=5,
        batch_size=1,
        validation_data=(test_images, test_labels)
)

Note

The python code above is slightly different from the tutorial code on the TensorFlow Post-training Integer Quantization, you can find more details from it.

We modify the sample code from the Tensorflow official website: TensorFlow Post-training Integer Quantization with fixing the value batch_size=1. The reason for fixing the value is that ncc-tflite doesn’t accept the dynamic-tensor-sized TensorFlow Lite model as an input to be converted to DLA file.

Floating-Point Model

Next, convert the trained Keras model to the TensorFlow Lite model.

converter = tf.lite.TFLiteConverter.from_keras_model(model)

tflite_model = converter.convert()

Now a TensorFlow Lite floating-point model is generated.

Quantization

Then, convert the floating-point model to the quantized one with post-training quantization.

def representative_data_gen():
for input_value in tf.data.Dataset.from_tensor_slices(train_images).batch(1).take(100):
        yield [input_value]

converter = tf.lite.TFLiteConverter.from_keras_model(model)

converter.optimizations = [tf.lite.Optimize.DEFAULT]
converter.representative_dataset = representative_data_gen
# Ensure that if any ops can't be quantized, the converter throws an error
converter.target_spec.supported_ops = [tf.lite.OpsSet.TFLITE_BUILTINS_INT8]
# Set the input and output tensors to uint8 (APIs added in r2.3)
converter.inference_input_type = tf.uint8
converter.inference_output_type = tf.uint8

tflite_model_quant = converter.convert()

Save the Model

Finally, we get a quantized model with .tflite extension.

import pathlib

tflite_models_dir = pathlib.Path("workspace/mnist_tflite_models/")
tflite_models_dir.mkdir(exist_ok=True, parents=True)

# Save the unquantized/float model:
tflite_model_file = tflite_models_dir/"mnist_model.tflite"
tflite_model_file.write_bytes(tflite_model)
# Save the quantized model:
tflite_model_quant_file = tflite_models_dir/"mnist_model_quant.tflite"
tflite_model_quant_file.write_bytes(tflite_model_quant)

Convert Quant Model to Neuron DLA Model

A DLA file is a MediaTek proprietary model which a low-level binary for MDLA and VPU compute devices.

Basic commands for using ncc-tflite to convert TFLite model to DLA file that can be inference on the APU:

$ ncc-tflite -arch mdla2.0,vpu /workspace/mnist_model_quant.tflite  -o /workspace/mnist_model_quant.dla

The output DLA model file is stored as mnist_model_quant.dla.

Note

For the details of ncc-tflite, please refer to Neuron Compiler section.

Appendix

Testing Environment for Model Conversion

$ pip list -v

Package                       Version              Location                                Installer
----------------------------- -------------------- --------------------------------------- ---------
absl-py                       1.4.0                /usr/local/lib/python3.10/dist-packages pip
alabaster                     0.7.13               /usr/local/lib/python3.10/dist-packages pip
albumentations                1.2.1                /usr/local/lib/python3.10/dist-packages pip
altair                        4.2.2                /usr/local/lib/python3.10/dist-packages pip
anyio                         3.6.2                /usr/local/lib/python3.10/dist-packages pip
appdirs                       1.4.4                /usr/local/lib/python3.10/dist-packages pip
argon2-cffi                   21.3.0               /usr/local/lib/python3.10/dist-packages pip
argon2-cffi-bindings          21.2.0               /usr/local/lib/python3.10/dist-packages pip
array-record                  0.2.0                /usr/local/lib/python3.10/dist-packages pip
arviz                         0.15.1               /usr/local/lib/python3.10/dist-packages pip
astropy                       5.2.2                /usr/local/lib/python3.10/dist-packages pip
astunparse                    1.6.3                /usr/local/lib/python3.10/dist-packages pip
attrs                         23.1.0               /usr/local/lib/python3.10/dist-packages pip
audioread                     3.0.0                /usr/local/lib/python3.10/dist-packages pip
autograd                      1.5                  /usr/local/lib/python3.10/dist-packages pip
Babel                         2.12.1               /usr/local/lib/python3.10/dist-packages pip
backcall                      0.2.0                /usr/local/lib/python3.10/dist-packages pip
beautifulsoup4                4.11.2               /usr/local/lib/python3.10/dist-packages pip
bleach                        6.0.0                /usr/local/lib/python3.10/dist-packages pip
blis                          0.7.9                /usr/local/lib/python3.10/dist-packages pip
blosc2                        2.0.0                /usr/local/lib/python3.10/dist-packages pip
bokeh                         2.4.3                /usr/local/lib/python3.10/dist-packages pip
branca                        0.6.0                /usr/local/lib/python3.10/dist-packages pip
build                         0.10.0               /usr/local/lib/python3.10/dist-packages pip
CacheControl                  0.12.11              /usr/local/lib/python3.10/dist-packages pip
cached-property               1.5.2                /usr/local/lib/python3.10/dist-packages pip
cachetools                    5.3.0                /usr/local/lib/python3.10/dist-packages pip
catalogue                     2.0.8                /usr/local/lib/python3.10/dist-packages pip
certifi                       2022.12.7            /usr/local/lib/python3.10/dist-packages pip
cffi                          1.15.1               /usr/local/lib/python3.10/dist-packages pip
chardet                       4.0.0                /usr/local/lib/python3.10/dist-packages pip
charset-normalizer            2.0.12               /usr/local/lib/python3.10/dist-packages pip
chex                          0.1.7                /usr/local/lib/python3.10/dist-packages pip
click                         8.1.3                /usr/local/lib/python3.10/dist-packages pip
cloudpickle                   2.2.1                /usr/local/lib/python3.10/dist-packages pip
cmake                         3.25.2               /usr/local/lib/python3.10/dist-packages pip
cmdstanpy                     1.1.0                /usr/local/lib/python3.10/dist-packages pip
colorcet                      3.0.1                /usr/local/lib/python3.10/dist-packages pip
colorlover                    0.3.0                /usr/local/lib/python3.10/dist-packages pip
community                     1.0.0b1              /usr/local/lib/python3.10/dist-packages pip
confection                    0.0.4                /usr/local/lib/python3.10/dist-packages pip
cons                          0.4.5                /usr/local/lib/python3.10/dist-packages pip
contextlib2                   0.6.0.post1          /usr/local/lib/python3.10/dist-packages pip
contourpy                     1.0.7                /usr/local/lib/python3.10/dist-packages pip
convertdate                   2.4.0                /usr/local/lib/python3.10/dist-packages pip
cryptography                  40.0.2               /usr/local/lib/python3.10/dist-packages pip
cufflinks                     0.17.3               /usr/local/lib/python3.10/dist-packages pip
cupy-cuda11x                  11.0.0               /usr/local/lib/python3.10/dist-packages pip
cvxopt                        1.3.0                /usr/local/lib/python3.10/dist-packages pip
cvxpy                         1.3.1                /usr/local/lib/python3.10/dist-packages pip
cycler                        0.11.0               /usr/local/lib/python3.10/dist-packages pip
cymem                         2.0.7                /usr/local/lib/python3.10/dist-packages pip
Cython                        0.29.34              /usr/local/lib/python3.10/dist-packages pip
dask                          2022.12.1            /usr/local/lib/python3.10/dist-packages pip
datascience                   0.17.6               /usr/local/lib/python3.10/dist-packages pip
db-dtypes                     1.1.1                /usr/local/lib/python3.10/dist-packages pip
dbus-python                   1.2.16               /usr/lib/python3/dist-packages
debugpy                       1.6.6                /usr/local/lib/python3.10/dist-packages pip
decorator                     4.4.2                /usr/local/lib/python3.10/dist-packages pip
defusedxml                    0.7.1                /usr/local/lib/python3.10/dist-packages pip
distributed                   2022.12.1            /usr/local/lib/python3.10/dist-packages pip
dlib                          19.24.1              /usr/local/lib/python3.10/dist-packages pip
dm-tree                       0.1.8                /usr/local/lib/python3.10/dist-packages pip
docutils                      0.16                 /usr/local/lib/python3.10/dist-packages pip
dopamine-rl                   4.0.6                /usr/local/lib/python3.10/dist-packages pip
duckdb                        0.7.1                /usr/local/lib/python3.10/dist-packages pip
earthengine-api               0.1.350              /usr/local/lib/python3.10/dist-packages pip
easydict                      1.10                 /usr/local/lib/python3.10/dist-packages pip
ecos                          2.0.12               /usr/local/lib/python3.10/dist-packages pip
editdistance                  0.6.2                /usr/local/lib/python3.10/dist-packages pip
en-core-web-sm                3.5.0                /usr/local/lib/python3.10/dist-packages pip
entrypoints                   0.4                  /usr/local/lib/python3.10/dist-packages pip
ephem                         4.1.4                /usr/local/lib/python3.10/dist-packages pip
et-xmlfile                    1.1.0                /usr/local/lib/python3.10/dist-packages pip
etils                         1.2.0                /usr/local/lib/python3.10/dist-packages pip
etuples                       0.3.8                /usr/local/lib/python3.10/dist-packages pip
exceptiongroup                1.1.1                /usr/local/lib/python3.10/dist-packages pip
fastai                        2.7.12               /usr/local/lib/python3.10/dist-packages pip
fastcore                      1.5.29               /usr/local/lib/python3.10/dist-packages pip
fastdownload                  0.0.7                /usr/local/lib/python3.10/dist-packages pip
fastjsonschema                2.16.3               /usr/local/lib/python3.10/dist-packages pip
fastprogress                  1.0.3                /usr/local/lib/python3.10/dist-packages pip
fastrlock                     0.8.1                /usr/local/lib/python3.10/dist-packages pip
filelock                      3.12.0               /usr/local/lib/python3.10/dist-packages pip
firebase-admin                5.3.0                /usr/local/lib/python3.10/dist-packages pip
Flask                         2.2.4                /usr/local/lib/python3.10/dist-packages pip
flatbuffers                   23.3.3               /usr/local/lib/python3.10/dist-packages pip
flax                          0.6.9                /usr/local/lib/python3.10/dist-packages pip
folium                        0.14.0               /usr/local/lib/python3.10/dist-packages pip
fonttools                     4.39.3               /usr/local/lib/python3.10/dist-packages pip
frozendict                    2.3.7                /usr/local/lib/python3.10/dist-packages pip
fsspec                        2023.4.0             /usr/local/lib/python3.10/dist-packages pip
future                        0.18.3               /usr/local/lib/python3.10/dist-packages pip
gast                          0.4.0                /usr/local/lib/python3.10/dist-packages pip
GDAL                          3.3.2                /usr/local/lib/python3.10/dist-packages pip
gdown                         4.6.6                /usr/local/lib/python3.10/dist-packages pip
gensim                        4.3.1                /usr/local/lib/python3.10/dist-packages pip
geographiclib                 2.0                  /usr/local/lib/python3.10/dist-packages pip
geopy                         2.3.0                /usr/local/lib/python3.10/dist-packages pip
gin-config                    0.5.0                /usr/local/lib/python3.10/dist-packages pip
glob2                         0.7                  /usr/local/lib/python3.10/dist-packages pip
google                        2.0.3                /usr/local/lib/python3.10/dist-packages pip
google-api-core               2.11.0               /usr/local/lib/python3.10/dist-packages pip
google-api-python-client      2.84.0               /usr/local/lib/python3.10/dist-packages pip
google-auth                   2.17.3               /usr/local/lib/python3.10/dist-packages pip
google-auth-httplib2          0.1.0                /usr/local/lib/python3.10/dist-packages pip
google-auth-oauthlib          0.4.6                /usr/local/lib/python3.10/dist-packages pip
google-cloud-bigquery         3.9.0                /usr/local/lib/python3.10/dist-packages pip
google-cloud-bigquery-storage 2.19.1               /usr/local/lib/python3.10/dist-packages pip
google-cloud-core             2.3.2                /usr/local/lib/python3.10/dist-packages pip
google-cloud-datastore        2.15.1               /usr/local/lib/python3.10/dist-packages pip
google-cloud-firestore        2.11.0               /usr/local/lib/python3.10/dist-packages pip
google-cloud-language         2.9.1                /usr/local/lib/python3.10/dist-packages pip
google-cloud-storage          2.8.0                /usr/local/lib/python3.10/dist-packages pip
google-cloud-translate        3.11.1               /usr/local/lib/python3.10/dist-packages pip
google-colab                  1.0.0                /usr/local/lib/python3.10/dist-packages pip
google-crc32c                 1.5.0                /usr/local/lib/python3.10/dist-packages pip
google-pasta                  0.2.0                /usr/local/lib/python3.10/dist-packages pip
google-resumable-media        2.5.0                /usr/local/lib/python3.10/dist-packages pip
googleapis-common-protos      1.59.0               /usr/local/lib/python3.10/dist-packages pip
googledrivedownloader         0.4                  /usr/local/lib/python3.10/dist-packages pip
graphviz                      0.20.1               /usr/local/lib/python3.10/dist-packages pip
greenlet                      2.0.2                /usr/local/lib/python3.10/dist-packages pip
grpcio                        1.54.0               /usr/local/lib/python3.10/dist-packages pip
grpcio-status                 1.48.2               /usr/local/lib/python3.10/dist-packages pip
gspread                       3.4.2                /usr/local/lib/python3.10/dist-packages pip
gspread-dataframe             3.0.8                /usr/local/lib/python3.10/dist-packages pip
gym                           0.25.2               /usr/local/lib/python3.10/dist-packages pip
gym-notices                   0.0.8                /usr/local/lib/python3.10/dist-packages pip
h5netcdf                      1.1.0                /usr/local/lib/python3.10/dist-packages pip
h5py                          3.8.0                /usr/local/lib/python3.10/dist-packages pip
hijri-converter               2.3.1                /usr/local/lib/python3.10/dist-packages pip
holidays                      0.23                 /usr/local/lib/python3.10/dist-packages pip
holoviews                     1.15.4               /usr/local/lib/python3.10/dist-packages pip
html5lib                      1.1                  /usr/local/lib/python3.10/dist-packages pip
httpimport                    1.3.0                /usr/local/lib/python3.10/dist-packages pip
httplib2                      0.21.0               /usr/local/lib/python3.10/dist-packages pip
humanize                      4.6.0                /usr/local/lib/python3.10/dist-packages pip
hyperopt                      0.2.7                /usr/local/lib/python3.10/dist-packages pip
idna                          3.4                  /usr/local/lib/python3.10/dist-packages pip
imageio                       2.25.1               /usr/local/lib/python3.10/dist-packages pip
imageio-ffmpeg                0.4.8                /usr/local/lib/python3.10/dist-packages pip
imagesize                     1.4.1                /usr/local/lib/python3.10/dist-packages pip
imbalanced-learn              0.10.1               /usr/local/lib/python3.10/dist-packages pip
imgaug                        0.4.0                /usr/local/lib/python3.10/dist-packages pip
importlib-resources           5.12.0               /usr/local/lib/python3.10/dist-packages pip
imutils                       0.5.4                /usr/local/lib/python3.10/dist-packages pip
inflect                       6.0.4                /usr/local/lib/python3.10/dist-packages pip
iniconfig                     2.0.0                /usr/local/lib/python3.10/dist-packages pip
intel-openmp                  2023.1.0             /usr/local/lib/python3.10/dist-packages pip
ipykernel                     5.5.6                /usr/local/lib/python3.10/dist-packages pip
ipython                       7.34.0               /usr/local/lib/python3.10/dist-packages pip
ipython-genutils              0.2.0                /usr/local/lib/python3.10/dist-packages pip
ipython-sql                   0.4.1                /usr/local/lib/python3.10/dist-packages pip
ipywidgets                    7.7.1                /usr/local/lib/python3.10/dist-packages pip
itsdangerous                  2.1.2                /usr/local/lib/python3.10/dist-packages pip
jax                           0.4.8                /usr/local/lib/python3.10/dist-packages pip
jaxlib                        0.4.7+cuda11.cudnn86 /usr/local/lib/python3.10/dist-packages pip
jieba                         0.42.1               /usr/local/lib/python3.10/dist-packages pip
Jinja2                        3.1.2                /usr/local/lib/python3.10/dist-packages pip
joblib                        1.2.0                /usr/local/lib/python3.10/dist-packages pip
jsonpickle                    3.0.1                /usr/local/lib/python3.10/dist-packages pip
jsonschema                    4.3.3                /usr/local/lib/python3.10/dist-packages pip
jupyter-client                6.1.12               /usr/local/lib/python3.10/dist-packages pip
jupyter-console               6.1.0                /usr/local/lib/python3.10/dist-packages pip
jupyter_core                  5.3.0                /usr/local/lib/python3.10/dist-packages pip
jupyter-server                1.24.0               /usr/local/lib/python3.10/dist-packages pip
jupyterlab-pygments           0.2.2                /usr/local/lib/python3.10/dist-packages pip
jupyterlab-widgets            3.0.7                /usr/local/lib/python3.10/dist-packages pip
kaggle                        1.5.13               /usr/local/lib/python3.10/dist-packages pip
keras                         2.8.0                /usr/local/lib/python3.10/dist-packages pip
Keras-Preprocessing           1.1.2                /usr/local/lib/python3.10/dist-packages pip
kiwisolver                    1.4.4                /usr/local/lib/python3.10/dist-packages pip
korean-lunar-calendar         0.3.1                /usr/local/lib/python3.10/dist-packages pip
langcodes                     3.3.0                /usr/local/lib/python3.10/dist-packages pip
lazy_loader                   0.2                  /usr/local/lib/python3.10/dist-packages pip
libclang                      16.0.0               /usr/local/lib/python3.10/dist-packages pip
librosa                       0.10.0.post2         /usr/local/lib/python3.10/dist-packages pip
lightgbm                      3.3.5                /usr/local/lib/python3.10/dist-packages pip
lit                           16.0.3               /usr/local/lib/python3.10/dist-packages pip
llvmlite                      0.39.1               /usr/local/lib/python3.10/dist-packages pip
locket                        1.0.0                /usr/local/lib/python3.10/dist-packages pip
logical-unification           0.4.5                /usr/local/lib/python3.10/dist-packages pip
LunarCalendar                 0.0.9                /usr/local/lib/python3.10/dist-packages pip
lxml                          4.9.2                /usr/local/lib/python3.10/dist-packages pip
Markdown                      3.4.3                /usr/local/lib/python3.10/dist-packages pip
markdown-it-py                2.2.0                /usr/local/lib/python3.10/dist-packages pip
MarkupSafe                    2.1.2                /usr/local/lib/python3.10/dist-packages pip
matplotlib                    3.7.1                /usr/local/lib/python3.10/dist-packages pip
matplotlib-inline             0.1.6                /usr/local/lib/python3.10/dist-packages pip
matplotlib-venn               0.11.9               /usr/local/lib/python3.10/dist-packages pip
mdurl                         0.1.2                /usr/local/lib/python3.10/dist-packages pip
miniKanren                    1.0.3                /usr/local/lib/python3.10/dist-packages pip
missingno                     0.5.2                /usr/local/lib/python3.10/dist-packages pip
mistune                       0.8.4                /usr/local/lib/python3.10/dist-packages pip
mizani                        0.8.1                /usr/local/lib/python3.10/dist-packages pip
mkl                           2019.0               /usr/local/lib/python3.10/dist-packages pip
ml-dtypes                     0.1.0                /usr/local/lib/python3.10/dist-packages pip
mlxtend                       0.14.0               /usr/local/lib/python3.10/dist-packages pip
more-itertools                9.1.0                /usr/local/lib/python3.10/dist-packages pip
moviepy                       1.0.3                /usr/local/lib/python3.10/dist-packages pip
mpmath                        1.3.0                /usr/local/lib/python3.10/dist-packages pip
msgpack                       1.0.5                /usr/local/lib/python3.10/dist-packages pip
multipledispatch              0.6.0                /usr/local/lib/python3.10/dist-packages pip
multitasking                  0.0.11               /usr/local/lib/python3.10/dist-packages pip
murmurhash                    1.0.9                /usr/local/lib/python3.10/dist-packages pip
music21                       8.1.0                /usr/local/lib/python3.10/dist-packages pip
natsort                       8.3.1                /usr/local/lib/python3.10/dist-packages pip
nbclient                      0.7.4                /usr/local/lib/python3.10/dist-packages pip
nbconvert                     6.5.4                /usr/local/lib/python3.10/dist-packages pip
nbformat                      5.8.0                /usr/local/lib/python3.10/dist-packages pip
nest-asyncio                  1.5.6                /usr/local/lib/python3.10/dist-packages pip
networkx                      3.1                  /usr/local/lib/python3.10/dist-packages pip
nibabel                       3.0.2                /usr/local/lib/python3.10/dist-packages pip
nltk                          3.8.1                /usr/local/lib/python3.10/dist-packages pip
notebook                      6.4.8                /usr/local/lib/python3.10/dist-packages pip
numba                         0.56.4               /usr/local/lib/python3.10/dist-packages pip
numexpr                       2.8.4                /usr/local/lib/python3.10/dist-packages pip
numpy                         1.24.3               /usr/local/lib/python3.10/dist-packages pip
oauth2client                  4.1.3                /usr/local/lib/python3.10/dist-packages pip
oauthlib                      3.2.2                /usr/local/lib/python3.10/dist-packages pip
opencv-contrib-python         4.7.0.72             /usr/local/lib/python3.10/dist-packages pip
opencv-python                 4.7.0.72             /usr/local/lib/python3.10/dist-packages pip
opencv-python-headless        4.7.0.72             /usr/local/lib/python3.10/dist-packages pip
openpyxl                      3.0.10               /usr/local/lib/python3.10/dist-packages pip
opt-einsum                    3.3.0                /usr/local/lib/python3.10/dist-packages pip
optax                         0.1.5                /usr/local/lib/python3.10/dist-packages pip
orbax-checkpoint              0.2.1                /usr/local/lib/python3.10/dist-packages pip
osqp                          0.6.2.post8          /usr/local/lib/python3.10/dist-packages pip
packaging                     23.1                 /usr/local/lib/python3.10/dist-packages pip
palettable                    3.3.3                /usr/local/lib/python3.10/dist-packages pip
pandas                        1.5.3                /usr/local/lib/python3.10/dist-packages pip
pandas-datareader             0.10.0               /usr/local/lib/python3.10/dist-packages pip
pandas-gbq                    0.17.9               /usr/local/lib/python3.10/dist-packages pip
pandocfilters                 1.5.0                /usr/local/lib/python3.10/dist-packages pip
panel                         0.14.4               /usr/local/lib/python3.10/dist-packages pip
param                         1.13.0               /usr/local/lib/python3.10/dist-packages pip
parso                         0.8.3                /usr/local/lib/python3.10/dist-packages pip
partd                         1.4.0                /usr/local/lib/python3.10/dist-packages pip
pathlib                       1.0.1                /usr/local/lib/python3.10/dist-packages pip
pathy                         0.10.1               /usr/local/lib/python3.10/dist-packages pip
patsy                         0.5.3                /usr/local/lib/python3.10/dist-packages pip
pexpect                       4.8.0                /usr/local/lib/python3.10/dist-packages pip
pickleshare                   0.7.5                /usr/local/lib/python3.10/dist-packages pip
Pillow                        8.4.0                /usr/local/lib/python3.10/dist-packages pip
pip                           23.1.2               /usr/local/lib/python3.10/dist-packages pip
pip-tools                     6.13.0               /usr/local/lib/python3.10/dist-packages pip
platformdirs                  3.3.0                /usr/local/lib/python3.10/dist-packages pip
plotly                        5.13.1               /usr/local/lib/python3.10/dist-packages pip
plotnine                      0.10.1               /usr/local/lib/python3.10/dist-packages pip
pluggy                        1.0.0                /usr/local/lib/python3.10/dist-packages pip
polars                        0.17.3               /usr/local/lib/python3.10/dist-packages pip
pooch                         1.6.0                /usr/local/lib/python3.10/dist-packages pip
portpicker                    1.3.9                /usr/local/lib/python3.10/dist-packages pip
prefetch-generator            1.0.3                /usr/local/lib/python3.10/dist-packages pip
preshed                       3.0.8                /usr/local/lib/python3.10/dist-packages pip
prettytable                   0.7.2                /usr/local/lib/python3.10/dist-packages pip
proglog                       0.1.10               /usr/local/lib/python3.10/dist-packages pip
progressbar2                  4.2.0                /usr/local/lib/python3.10/dist-packages pip
prometheus-client             0.16.0               /usr/local/lib/python3.10/dist-packages pip
promise                       2.3                  /usr/local/lib/python3.10/dist-packages pip
prompt-toolkit                3.0.38               /usr/local/lib/python3.10/dist-packages pip
prophet                       1.1.2                /usr/local/lib/python3.10/dist-packages pip
proto-plus                    1.22.2               /usr/local/lib/python3.10/dist-packages pip
protobuf                      3.20.3               /usr/local/lib/python3.10/dist-packages pip
psutil                        5.9.5                /usr/local/lib/python3.10/dist-packages pip
psycopg2                      2.9.6                /usr/local/lib/python3.10/dist-packages pip
ptyprocess                    0.7.0                /usr/local/lib/python3.10/dist-packages pip
py-cpuinfo                    9.0.0                /usr/local/lib/python3.10/dist-packages pip
py4j                          0.10.9.7             /usr/local/lib/python3.10/dist-packages pip
pyarrow                       9.0.0                /usr/local/lib/python3.10/dist-packages pip
pyasn1                        0.5.0                /usr/local/lib/python3.10/dist-packages pip
pyasn1-modules                0.3.0                /usr/local/lib/python3.10/dist-packages pip
pycocotools                   2.0.6                /usr/local/lib/python3.10/dist-packages pip
pycparser                     2.21                 /usr/local/lib/python3.10/dist-packages pip
pyct                          0.5.0                /usr/local/lib/python3.10/dist-packages pip
pydantic                      1.10.7               /usr/local/lib/python3.10/dist-packages pip
pydata-google-auth            1.7.0                /usr/local/lib/python3.10/dist-packages pip
pydot                         1.4.2                /usr/local/lib/python3.10/dist-packages pip
pydot-ng                      2.0.0                /usr/local/lib/python3.10/dist-packages pip
pydotplus                     2.0.2                /usr/local/lib/python3.10/dist-packages pip
PyDrive                       1.3.1                /usr/local/lib/python3.10/dist-packages pip
pyerfa                        2.0.0.3              /usr/local/lib/python3.10/dist-packages pip
pygame                        2.3.0                /usr/local/lib/python3.10/dist-packages pip
Pygments                      2.14.0               /usr/local/lib/python3.10/dist-packages pip
PyGObject                     3.36.0               /usr/lib/python3/dist-packages
pymc                          5.1.2                /usr/local/lib/python3.10/dist-packages pip
PyMeeus                       0.5.12               /usr/local/lib/python3.10/dist-packages pip
pymystem3                     0.2.0                /usr/local/lib/python3.10/dist-packages pip
PyOpenGL                      3.1.6                /usr/local/lib/python3.10/dist-packages pip
pyparsing                     3.0.9                /usr/local/lib/python3.10/dist-packages pip
pyproject_hooks               1.0.0                /usr/local/lib/python3.10/dist-packages pip
pyrsistent                    0.19.3               /usr/local/lib/python3.10/dist-packages pip
PySocks                       1.7.1                /usr/local/lib/python3.10/dist-packages pip
pytensor                      2.10.1               /usr/local/lib/python3.10/dist-packages pip
pytest                        7.2.2                /usr/local/lib/python3.10/dist-packages pip
python-apt                    0.0.0                /usr/local/lib/python3.10/dist-packages
python-dateutil               2.8.2                /usr/local/lib/python3.10/dist-packages pip
python-louvain                0.16                 /usr/local/lib/python3.10/dist-packages pip
python-slugify                8.0.1                /usr/local/lib/python3.10/dist-packages pip
python-utils                  3.5.2                /usr/local/lib/python3.10/dist-packages pip
pytz                          2022.7.1             /usr/local/lib/python3.10/dist-packages pip
pytz-deprecation-shim         0.1.0.post0          /usr/local/lib/python3.10/dist-packages pip
pyviz-comms                   2.2.1                /usr/local/lib/python3.10/dist-packages pip
PyWavelets                    1.4.1                /usr/local/lib/python3.10/dist-packages pip
PyYAML                        6.0                  /usr/local/lib/python3.10/dist-packages pip
pyzmq                         23.2.1               /usr/local/lib/python3.10/dist-packages pip
qdldl                         0.1.7                /usr/local/lib/python3.10/dist-packages pip
qudida                        0.0.4                /usr/local/lib/python3.10/dist-packages pip
regex                         2022.10.31           /usr/local/lib/python3.10/dist-packages pip
requests                      2.27.1               /usr/local/lib/python3.10/dist-packages pip
requests-oauthlib             1.3.1                /usr/local/lib/python3.10/dist-packages pip
requests-unixsocket           0.2.0                /usr/lib/python3/dist-packages
requirements-parser           0.5.0                /usr/local/lib/python3.10/dist-packages pip
rich                          13.3.4               /usr/local/lib/python3.10/dist-packages pip
rpy2                          3.5.5                /usr/local/lib/python3.10/dist-packages pip
rsa                           4.9                  /usr/local/lib/python3.10/dist-packages pip
scikit-image                  0.19.3               /usr/local/lib/python3.10/dist-packages pip
scikit-learn                  1.2.2                /usr/local/lib/python3.10/dist-packages pip
scipy                         1.10.1               /usr/local/lib/python3.10/dist-packages pip
scs                           3.2.3                /usr/local/lib/python3.10/dist-packages pip
seaborn                       0.12.2               /usr/local/lib/python3.10/dist-packages pip
Send2Trash                    1.8.0                /usr/local/lib/python3.10/dist-packages pip
setuptools                    67.7.2               /usr/local/lib/python3.10/dist-packages pip
shapely                       2.0.1                /usr/local/lib/python3.10/dist-packages pip
six                           1.16.0               /usr/local/lib/python3.10/dist-packages pip
sklearn-pandas                2.2.0                /usr/local/lib/python3.10/dist-packages pip
smart-open                    6.3.0                /usr/local/lib/python3.10/dist-packages pip
sniffio                       1.3.0                /usr/local/lib/python3.10/dist-packages pip
snowballstemmer               2.2.0                /usr/local/lib/python3.10/dist-packages pip
sortedcontainers              2.4.0                /usr/local/lib/python3.10/dist-packages pip
soundfile                     0.12.1               /usr/local/lib/python3.10/dist-packages pip
soupsieve                     2.4.1                /usr/local/lib/python3.10/dist-packages pip
soxr                          0.3.5                /usr/local/lib/python3.10/dist-packages pip
spacy                         3.5.2                /usr/local/lib/python3.10/dist-packages pip
spacy-legacy                  3.0.12               /usr/local/lib/python3.10/dist-packages pip
spacy-loggers                 1.0.4                /usr/local/lib/python3.10/dist-packages pip
Sphinx                        3.5.4                /usr/local/lib/python3.10/dist-packages pip
sphinxcontrib-applehelp       1.0.4                /usr/local/lib/python3.10/dist-packages pip
sphinxcontrib-devhelp         1.0.2                /usr/local/lib/python3.10/dist-packages pip
sphinxcontrib-htmlhelp        2.0.1                /usr/local/lib/python3.10/dist-packages pip
sphinxcontrib-jsmath          1.0.1                /usr/local/lib/python3.10/dist-packages pip
sphinxcontrib-qthelp          1.0.3                /usr/local/lib/python3.10/dist-packages pip
sphinxcontrib-serializinghtml 1.1.5                /usr/local/lib/python3.10/dist-packages pip
SQLAlchemy                    2.0.10               /usr/local/lib/python3.10/dist-packages pip
sqlparse                      0.4.4                /usr/local/lib/python3.10/dist-packages pip
srsly                         2.4.6                /usr/local/lib/python3.10/dist-packages pip
statsmodels                   0.13.5               /usr/local/lib/python3.10/dist-packages pip
sympy                         1.11.1               /usr/local/lib/python3.10/dist-packages pip
tables                        3.8.0                /usr/local/lib/python3.10/dist-packages pip
tabulate                      0.8.10               /usr/local/lib/python3.10/dist-packages pip
tblib                         1.7.0                /usr/local/lib/python3.10/dist-packages pip
tenacity                      8.2.2                /usr/local/lib/python3.10/dist-packages pip
tensorboard                   2.8.0                /usr/local/lib/python3.10/dist-packages pip
tensorboard-data-server       0.6.1                /usr/local/lib/python3.10/dist-packages pip
tensorboard-plugin-wit        1.8.1                /usr/local/lib/python3.10/dist-packages pip
tensorflow                    2.8.0                /usr/local/lib/python3.10/dist-packages pip
tensorflow-datasets           4.9.2                /usr/local/lib/python3.10/dist-packages pip
tensorflow-estimator          2.12.0               /usr/local/lib/python3.10/dist-packages pip
tensorflow-gcs-config         2.12.0               /usr/local/lib/python3.10/dist-packages pip
tensorflow-hub                0.13.0               /usr/local/lib/python3.10/dist-packages pip
tensorflow-io-gcs-filesystem  0.32.0               /usr/local/lib/python3.10/dist-packages pip
tensorflow-metadata           1.13.1               /usr/local/lib/python3.10/dist-packages pip
tensorflow-model-optimization 0.7.4                /usr/local/lib/python3.10/dist-packages pip
tensorflow-probability        0.19.0               /usr/local/lib/python3.10/dist-packages pip
tensorstore                   0.1.36               /usr/local/lib/python3.10/dist-packages pip
termcolor                     2.3.0                /usr/local/lib/python3.10/dist-packages pip
terminado                     0.17.1               /usr/local/lib/python3.10/dist-packages pip
text-unidecode                1.3                  /usr/local/lib/python3.10/dist-packages pip
textblob                      0.17.1               /usr/local/lib/python3.10/dist-packages pip
tf-estimator-nightly          2.8.0.dev2021122109  /usr/local/lib/python3.10/dist-packages pip
tf-slim                       1.1.0                /usr/local/lib/python3.10/dist-packages pip
thinc                         8.1.9                /usr/local/lib/python3.10/dist-packages pip
threadpoolctl                 3.1.0                /usr/local/lib/python3.10/dist-packages pip
tifffile                      2023.4.12            /usr/local/lib/python3.10/dist-packages pip
tinycss2                      1.2.1                /usr/local/lib/python3.10/dist-packages pip
toml                          0.10.2               /usr/local/lib/python3.10/dist-packages pip
tomli                         2.0.1                /usr/local/lib/python3.10/dist-packages pip
toolz                         0.12.0               /usr/local/lib/python3.10/dist-packages pip
torch                         2.0.0+cu118          /usr/local/lib/python3.10/dist-packages pip
torchaudio                    2.0.1+cu118          /usr/local/lib/python3.10/dist-packages pip
torchdata                     0.6.0                /usr/local/lib/python3.10/dist-packages pip
torchsummary                  1.5.1                /usr/local/lib/python3.10/dist-packages pip
torchtext                     0.15.1               /usr/local/lib/python3.10/dist-packages pip
torchvision                   0.15.1+cu118         /usr/local/lib/python3.10/dist-packages pip
tornado                       6.2                  /usr/local/lib/python3.10/dist-packages pip
tqdm                          4.65.0               /usr/local/lib/python3.10/dist-packages pip
traitlets                     5.7.1                /usr/local/lib/python3.10/dist-packages pip
triton                        2.0.0                /usr/local/lib/python3.10/dist-packages pip
tweepy                        4.13.0               /usr/local/lib/python3.10/dist-packages pip
typer                         0.7.0                /usr/local/lib/python3.10/dist-packages pip
types-setuptools              67.7.0.1             /usr/local/lib/python3.10/dist-packages pip
typing_extensions             4.5.0                /usr/local/lib/python3.10/dist-packages pip
tzdata                        2023.3               /usr/local/lib/python3.10/dist-packages pip
tzlocal                       4.3                  /usr/local/lib/python3.10/dist-packages pip
uritemplate                   4.1.1                /usr/local/lib/python3.10/dist-packages pip
urllib3                       1.26.15              /usr/local/lib/python3.10/dist-packages pip
vega-datasets                 0.9.0                /usr/local/lib/python3.10/dist-packages pip
wasabi                        1.1.1                /usr/local/lib/python3.10/dist-packages pip
wcwidth                       0.2.6                /usr/local/lib/python3.10/dist-packages pip
webcolors                     1.13                 /usr/local/lib/python3.10/dist-packages pip
webencodings                  0.5.1                /usr/local/lib/python3.10/dist-packages pip
websocket-client              1.5.1                /usr/local/lib/python3.10/dist-packages pip
Werkzeug                      2.3.0                /usr/local/lib/python3.10/dist-packages pip
wheel                         0.40.0               /usr/local/lib/python3.10/dist-packages pip
widgetsnbextension            3.6.4                /usr/local/lib/python3.10/dist-packages pip
wordcloud                     1.8.2.2              /usr/local/lib/python3.10/dist-packages pip
wrapt                         1.14.1               /usr/local/lib/python3.10/dist-packages pip
xarray                        2022.12.0            /usr/local/lib/python3.10/dist-packages pip
xarray-einstats               0.5.1                /usr/local/lib/python3.10/dist-packages pip
xgboost                       1.7.5                /usr/local/lib/python3.10/dist-packages pip
xlrd                          2.0.1                /usr/local/lib/python3.10/dist-packages pip
yellowbrick                   1.5                  /usr/local/lib/python3.10/dist-packages pip
yfinance                      0.2.18               /usr/local/lib/python3.10/dist-packages pip
zict                          3.0.0                /usr/local/lib/python3.10/dist-packages pip
zipp                          3.15.0               /usr/local/lib/python3.10/dist-packages pip