#

multi-modality

Here are 68 public repositories matching this topic...

ZwwWayne / mmMOT

[ICCV2019] Robust Multi-Modality Multi-Object Tracking

mot multi-modality iccv2019

Updated Dec 7, 2019
Python

sagahansson / aics-project

Final project for the course LT2318 Artificial Intelligence: Cognitive Systems. The project concerns multimodal hate speech detection in memes.

hate-speech multi-modality hate-speech-detection

Updated May 5, 2021
TeX

ecom-research / ComposeAE

Official code for WACV 2021 paper - Compositional Learning of Image-Text Query for Image Retrieval

information-retrieval multi-modality compositional-learning

Updated Oct 8, 2021
Python

rentainhe / TRAR-VQA

[ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"

visualization pytorch transformer attention official multi-modal clevr visual-question-answering vision-and-language dynamic-network multi-modality multi-modal-learning multi-scale-features vqav2 iccv2021 local-and-global

Updated Oct 11, 2021
Python

amazon-science / crossmodal-contrastive-learning

CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video Representations, ICCV 2021

natural-language-processing video computer-vision transformers video-captioning multi-modality contrastive-learning video-text-retrieval

Updated Feb 7, 2022
Python

lucidrains / deep-daze

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

deep-learning transformers artificial-intelligence siren text-to-image multi-modality implicit-neural-representation

Updated Mar 13, 2022
Python

dvlab-research / UVTR

Unifying Voxel-based Representation with Transformer for 3D Object Detection (NeurIPS 2022)

pytorch 3d-detection multi-modality

Updated Oct 19, 2022
Python

SaraElfetiany / Airbnb_price_category_prediction

Queen's University - Data Mining (CISC 873)

tensorflow lstm gru bidirectional transfer-learning vgg16 multi-objective multimodality word-embedding googletrans multi-modality

Updated Nov 10, 2022
Jupyter Notebook

CVPR21Chal-SLR

jackyjsy / CVPR21Chal-SLR

This repo contains the official code of our work SAM-SLR which won the CVPR 2021 Challenge on Large Scale Signer Independent Isolated Sign Language Recognition.

sign-language-recognition-system sign-language-recognition multi-modality cvpr2021 skeleton-features

Updated Nov 16, 2022
Python

anondo1969 / FedSepsis

Repository for the journal article, 'FedSepsis: A Federated Multi-Modal Deep Learning-Based Internet of Medical Things Application for Early Detection of Sepsis from Electronic Health Records Using Raspberry Pi and Jetson Nano Devices', Mahbub Ul Alam, Rahim Rahmani. Sensors 23, no. 2: 970, https://doi.org/10.3390/s23020970.

nlp raspberry-pi machine-learning natural-language-processing deep-learning gan electronic-health-records health-informatics sepsis federated-learning internet-of-medical-things multi-modality jetson-nano iomt clinicalbert early-sepsis-detection clinical-decision-support-system smart-healthcare

Updated Feb 5, 2023
Jupyter Notebook

wwweiwei / Pre-CoFactv2-AAAI-2023

Official Implementation for Pre-CoFactv2 (AAAI-23 DeFactify2.0 Workshop 1st Place)

ensemble multi-modality co-attention

Updated Feb 28, 2023
Python

Messi-Q / Cross-Modality-Bug-Detection

Cross-Modality Mutual Learning for Smart Contract Vulnerability Detection

vulnerability-detection smart-contract multi-modality mutual-learning

Updated Feb 28, 2023
Python

xufangzhi / MoCA

[Pattern Recognition] The implementation of MoCA

multi-modality textbook-question-answering

Updated Apr 1, 2023
Python

anondo1969 / thremaltimodal-covidetector

Repository for the conference paper 'COVID-19 detection from thermal image and tabular medical data utilizing multi-modal machine learning', Mahbub Ul Alam, Jaakko Hollmén and Rahim Rahmani. IEEE 36th International Symposium on Computer-Based Medical Systems (CBMS), 2023, pp. 646-653.

machine-learning deep-learning internet-of-medical-things multi-modality covid-19-detection thermal-image tabular-medical-data

Updated Jul 18, 2023
Python

OpenGVLab / LORIS

Long-Term Rhythmic Video Soundtracker, ICML2023

music-generation pytorch-implementation multi-modality diffusion-models aigc

Updated Jul 26, 2023
Python

kyegomez / the-compiler

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

reinforcement-learning deep-learning deep-learning-algorithms artficial-intelligence agora multimodal-deep-learning multi-modality multi-modal-fusion prompt-engineering chain-of-thought chatgpt autogpt tree-of-thoughts

Updated Jul 27, 2023
Python

jina-ai / rungpt

An open-source cloud-native of large multi-modal models (LMMs) serving framework.

transformers llama self-hosting flamingo multi-modality opengpt gpt-4 large-language-models large-multimadality-models llm-serve lmm-serve llm-hosting

Updated Sep 5, 2023
Python

ziqihuangg / Collaborative-Diffusion

Collaborative Diffusion (CVPR 2023)

image-editing image-generation face-generation multi-modality face-editing diffusion-models aigc stable-diffusion latent-diffusion-models gen-ai

Updated Nov 28, 2023
Python

RajGothi / Visual-Entities-Empowered-Zero-Shot-Image-to-Text-Generation-Transfer-Across-Domains

Visual Entities Empowered Zero-Shot Image-to-Text Generation Transfer Across Domains

computer-vision transformer image-captioning gpt multi-modal clip zero-shot-learning multi-modality vision-language-model

Updated Dec 11, 2023
Jupyter Notebook

researchmm / MM-Diffusion

[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation

video-generation multi-modality diffusion-models content-creation audio-generation

Updated Jan 15, 2024
Python

Improve this page

Add a description, image, and links to the multi-modality topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multi-modality topic, visit your repo's landing page and select "manage topics."