Skip to content

Jarvis AI is a Python Module which is able to perform task like Chatbot, Assistant etc. It provides base functionality for any assistant application. This JarvisAI is built using Tensorflow, Pytorch, Transformers and other opensource libraries and frameworks.

License

Notifications You must be signed in to change notification settings

Dipeshpal/Jarvis_AI

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Header

PythonTensorFlowPyTorch

Hello, folks!

This project is created only for those who are interested in building a Virtual Assistant. Generally, it took lots of time to write code from scratch to build a Virtual Assistant. So, I have built a Library called "JarvisAI", which gives you easy functionality to build your own Virtual Assistant.

Content-

  1. What is JarvisAI?
  2. Prerequisite
  3. Architecture
  4. Getting Started- How to use it?
  5. What it can do (Features it supports)
  6. Future / Request Features
  7. Contribute
  8. Contact me
  9. Donate
  10. Thank me on-

YouTube Tutorial-

Click on the image below to watch the tutorial on YouTube-

Tutorial 1-

JarvisAI Tutorial 1

Tutorial 2-

JarvisAI Tutorial 2

1. What is Jarvis AI?

Jarvis AI is a Python Module that is able to perform tasks like Chatbot, Assistant, etc. It provides base functionality for any assistant application. This JarvisAI is built using Tensorflow, Pytorch, Transformers, and other open-source libraries and frameworks. Well, you can contribute to this project to make it more powerful.

2. Prerequisite

  • Get your Free API key from https://jarvisai.in

  • To use it only Python (> 3.6) is required.

  • To contribute to the project: Python is the only prerequisite for basic scripting, Machine Learning, and Deep Learning knowledge will help this model to do tasks like AI-ML. Read the How to Contribute section of this page.

3. Architecture

The JarvisAI’s architecture is divided into two parts.

  1. User End- It is basically responsible for getting input from the user and after preprocessing input it sends input to JarvisAI’s server. And once the server sends its response back, it produces output on the user screen/system.

  2. Server Side- The server is responsible to handle various kinds of AI-ML, and NLP tasks. It mainly identifies user intent by analyzing user input and interacting with other external APIs and handling user input.

    JarvisAI’s Architecture

4. Getting Started- How to use it?

NOTE: Old version is depreciated use latest version of JarvisAI

4.1. Installation-

  • Install the latest version-

     pip install JarvisAI  

Optional Steps (Common Installation Issues)-

  • [Optional Step] If Pyaudio is not working or not installed you might need to install it separately-

    In the case of Mac OSX do the following:

     brew install portaudio  
     pip install pyaudio  
    

In the case of Windows or Linux do the following:

  • Download pyaudio from: lfd.uci.edu/~gohlke/pythonlibs/#pyaudio

  • pip install PyAudio-0.2.11-cp310-cp310-win_amd64.whl

4.2. Code You Need-

You need only this piece of code-

def custom_function(*args, **kwargs):
    command = kwargs.get('query')
    entities = kwargs.get('entities')
    print(entities)
    # write your code here to do something with the command
    # perform some tasks # return is optional
    return command + ' Executed'


jarvis = JarvisAI.Jarvis(input_mechanism='voice', output_mechanism='both',
                google_speech_api_key=None, backend_tts_api='pyttsx3',
                use_whisper_asr=False, display_logs=False,
                api_key='527557f2-0b67-4500-8ca0-03766ade589a')
# add_action("general", custom_function)  # OPTIONAL
jarvis.start()

4.3. What's now?

It will start your AI, it will ask you to give input and accordingly it will produce output.
You can configure input_mechanism and output_mechanism parameter for voice input/output or text input/output.

4.4. Let's understand the Parameters-

READ MORE: Google Speech API (Pricing and Key) at: https://cloud.google.com/speech-to-text  

5. What it can do (Features it supports)-

  1. Currently, it supports only english language
  2. Supports voice and text input/output.
  3. Supports AI based voice input (using whisper asr) and by using google api voice input.
  4. All intellectual task is process in JarvisAI server so there is no load on your system.
  5. Lightweight and able to understand natural language (commands)
  6. Ability to add your own custom functions.

5.1. Supported Commands-

These are below supported intent that AI can handle, you can ask in natural language.

Example- "What is the time now", "make me laugh", "click a photo", etc.

Note: Some features / command might not work. WIP. Tell me bugs.

  1. asking time
  2. asking date
  3. greet and hello hi kind of things goodbye
  4. tell me joke
  5. tell me about
  6. i am bored
  7. volume control
  8. tell me news
  9. click photo
  10. places near me
  11. play on youtube
  12. play games
  13. what can you do
  14. send email
  15. download youtube video
  16. asking weather
  17. take screenshot
  18. open website
  19. send whatsapp message
  20. covid cases
  21. check internet speed
  22. others / Unknown Intent (IN PROGRESS)

5.2. Supported Input/Output Methods (Which option do I need to choose?)-

You can set below parameter while creating object of JarvisAI-

jarvis = JarvisAI.Jarvis(input_mechanism='voice', output_mechanism='both',  
                google_speech_api_key=None, backend_tts_api='pyttsx3',  
                use_whisper_asr=False, display_logs=False,  
                api_key='527557f2-0b67-4500-8ca0-03766ade589a')
  1. For text input-'

     input_mechanism='text'
    
  2. For voice input-

     input_mechanism='voice'
    
  3. For text output-

     output_mechanism='text'
    
  4. For voice output-

     output_mechanism='text'
    
  5. For voice and text output-

     output_mechanism='both'
    

6. Future/Request Features-

WIP
You tell me

7. Contribute-

Instructions Coming Soon

8. Contact me-

9. Donate-

Donate and Contribute to run me this project, and buy a domain

Feel free to use my code, don't forget to mention credit. All the contributors will get credits in this repo.
Mention below line for credits-
Credits-

10. Thank me on-

License

MIT

About

Jarvis AI is a Python Module which is able to perform task like Chatbot, Assistant etc. It provides base functionality for any assistant application. This JarvisAI is built using Tensorflow, Pytorch, Transformers and other opensource libraries and frameworks.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages