[P] Data analysis made easy: Text2Code for Jupyter notebook

Hong Kong Corporate Income Tax (CIT)
September 14, 2020
Koh phi phi Thailand. It's empty, just me and my girl on an empty beach.
September 14, 2020

[P] Data analysis made easy: Text2Code for Jupyter notebook

[P] Data analysis made easy: Text2Code for Jupyter notebook

A ready-to-install jupyter extension which converts english queries into relevant code. Built as a proof of concept for the problem we personally face of forgetting less-used syntaxes of pandas and plotly libraries which is often used in Exploratory Data Analysis. This tool allows us to query in a generic language without having to remember the syntax.

Inspired by cool GPT-3 demos and not having the access to the API, here is an attempt by us to build a Text2Code extension using publicly available libraries. The approach isn't generative, but relies on identifying & matching from a set of predefined intents and generating the relevant code by extracting relevant entities and inserting them in a template. Adding new intents and extending the functionality is easy once the pipeline is in place.

Technologies used:

  • Universal Sentence Encoder
  • Spacy
  • Faiss
  • Jupyter extension

Code: https://github.com/deepklarity/jupyter-text2code

https://i.redd.it/aynqesrswol51.gif

submitted by /u/deepak_s_rawat
[link] [comments]

Source

Comments are closed.