... and deploying on Google Chrome with FastAPI and Docker
I recently finished the fantastic new Natural Language Processing with Transformers book written by a few guys on the Hugging Face team and was inspired to put some of my newfound knowledge to use with a little NLP-based project. While searching for some ideas I came across an excellent blog post by Tezan Sahu in which he built a Microsoft Edge extension to paraphrase text highlighted on your screen. I wanted to take this a step further by:
optimizing model inference with ONNX runtime and quantization,
include features such as summarization, name entity recognition (NER), and keyword extraction.