Joseph K J
Research Scientist atAdobe Research
I am acomputer vision researcher. Most of my explorations draws inspiration from the ingenuity of human brain. Its ability to improve itself with experiences, quantify what it does not know, and its natural instinct to be creative guides my research in multi-modal learning, continual learning, open-world learning, class-discovery and generative modeling with deep neural networks.
I obtained my PhD and Master’s degree fromIIT Hyderabad under the guidance ofProf. Vineeth N Balasubramanian.
e-mail: josephkj (at) adobe.com or josephkj20 (at) gmail.com
News
| Dec 14, 2024 | Humbled to receive theIUPRAI Doctoral Dissertation Award! All credits tomy advisor, friends and my family. |
| Aug 30, 2024 | Design-o-meter, an approach to evaluate and refine design documents is accepted to WACV 2025 (round 1, acceptance rate 12.1%). Kudos to my brilliant undergraduate interns:Sahil Goyal (IIT Roorkee) andAbhinav Mahajan (IIIT Bangalore). |
| Jul 1, 2024 | Prachi’s work on continual gesture recoginition is accepted toECCV 2024 as anoral paper! |
| Feb 27, 2024 | MeLFusion is accepted toCVPR 2024 as ahighlight poster (11.9% acceptance rate)! Joint work with my first batch of interns at Adobe:Sanjoy (UMD) andSayan (U of T). |
| Feb 3, 2024 | Excited to be a participant at the inaugural edition ofACM India’s PIC! |
| Jan 6, 2024 | Runner-up atACM IKDD Doctoral Dissertation Award 2024! |
| Dec 9, 2023 | Ourwork on contextualized prompt learning is accepted toAAAI 2024 as anoral paper. |
| Oct 24, 2023 | Ourwork at Adobe on using diffusion models for iterative image editing is accepted to WACV 2024. |
| Jul 14, 2023 | Two papers accepted toICCV 2023. Thanks to my brilliant collaborators atAdobe Research andCMU. |
| Nov 14, 2022 | JoinedAdobe Research as aResearch Scientist. |
| Jul 9, 2022 | Two papers accepted toECCV 2022. |
| Jun 21, 2022 | WonAI-GameChangers award in the Deep Learning Algorithms category. Thank you, NASSCOM! |
| Jun 20, 2022 | Ourwork on class discovery won theBest Paper Runner-UpAward atCLVision workshop, CVPR 2022. |
| Apr 15, 2022 | Accepted toDoctoral Consortium at CVPR 2022, mentored byProf. Trevor Darrell. |
| Apr 7, 2022 | Humbled to recieve Excellence in Research Award from IIT Hyderabadsecond time! |
| Mar 2, 2022 | Two papers accepted atCVPR 2022. |
| Oct 11, 2021 | Our work onIncremental Object Detection is accepted toTPAMI (Impact Factor: 16.39). |
| Aug 8, 2021 | Continuing atGoogle as a Student Researcher. |
| Apr 5, 2021 | JoinedGoogle Research as an Intern. |
| Mar 1, 2021 | Our work on Open World Object Detection, is accepted atCVPR 2021 fororal presentation. |
| Sep 25, 2020 | Our work on using Meta-Consolidation for Continual Learning is accepted atNeurIPS 2020. |
| Aug 30, 2020 | Humbled to recieveExcellence in Research Award from IIT Hyderabad. |
| Jul 30, 2020 | Our work on Zero-shot Domain Generalization is accepted atBMVC 2020. |
| Nov 24, 2019 | JoinedIIAI /MBZUAI, Abu Dhabi as a Research Intern. |
| Aug 8, 2019 | AwardedTCS PhD Fellowship! |
| May 21, 2019 | Our work on using submodular optimization is accepted atNegative Dependence workshop,ICML 2019. |
| May 21, 2019 | Humbled to receive Travel Grants fromMicrosoft Research andACM-India / IARCS to attend IJCAI. |
| May 10, 2019 | Our work titled ‘Submodular Batch Selection for Training Deep Neural Networks’ is accepted atIJCAI 2019. |
| Apr 16, 2019 | Would be attendingInternational Computer Vision Summer School,ICVSS 2019 in Sicily, Italy. |
| Mar 14, 2019 | Awarded‘Certificate of Appreciation in Research’ from IIT Hyderabad. |
| Aug 31, 2018 | Our paper titled ‘C4Synth: Cross-Caption Cycle-Consistent Text-to-Image Synthesis’, is accepted atWACV 2019. |
| Aug 6, 2018 | MASON accepted atAutoNUE workshop,ECCV 2018, Germany. |
| Jul 24, 2018 | Interned atHarada-Ushiku lab, University of Tokyo, Japan. |
| Jun 29, 2018 | Ourpaper accepted at ‘Towards learning with limited labels’ workshop,ICML 2018, Sweden. |
Talks and Lectures
| Dec 13, 2024 | Delivered a tutorial on Multi-modal Generative Models atICVGIP 2024. |
| Dec 7, 2024 | Delivered a tutorial on Generative Models atWinter School on Generative AI, organized by IIT Jodhpur. |
| Jul 3, 2024 | Delivered a tutorial on Generative Models atSummer School on AI, organized by IIIT H. |
| Nov 25, 2023 | Delivered a tutorial on “Augmenting Human Creativity with Computer Vision” atHAAI, IIT Kharagpur. |
| Jul 13, 2023 | Delivered a tutorial on Continual Learning atSummer School on AI, organized by IIIT H. |
| Dec 12, 2022 | Invited talk atContinual Lifelong Learning Workshop co-located with ACML 2022. |
| Jun 14, 2022 | Invited talk at Rakuten Research. |
| Dec 22, 2021 | Vision India at ICVGIP 2021. |
| Sep 1, 2021 | TCS Reseach ReCafe. |
| May 14, 2021 | Invited talk on open-world learning at RAM-LAB, HKUST. |
Collaborators
PhD Interns at Adobe Research:- 2023:Sanjoy Chowdhury (UMD),Sayan Nag (UoT).[MeLFusion, CVPR 2024]
- 2023:Sahil Goyal (IIT R -> Google Deepmind),Karthik Viswanathan (IIIT H -> PhD at MILA), Abhinav Mahajan (IIIT B), Vinay Kumar Cheerla (IIT B), Dev Shah (IIT G), Mandar Wayal (IIT K).[Design-o-meter, WACV 2025]
- Prachi Garg (MSR at CMU -> PhD at UIUC). [POET, ECCV 2024]
- Shubhra Aich (CMU). [BOAT-MI, ICCV 2023]
- Arjun Ashok (IIT H -> PhD at MILA).[CSCCT, ECCV 2022]
- Akshita Gupta (MBZUAI -> MSc at University of Guelph). [OW-DETR, CVPR 2022]
- MBZUAI:Salman Khan,Fahad Khan.
- CMU:Fernando De la Torre.
- Google Research:Gaurav Aggarwal,Kai Han,Sujoy Paul,Soma Biswas,Piyush Rai.
- + of-course, mydoctoral advisor.
- + all amazing colleagues atAdobe Research!
Services
- Tutorial Chair forICVGIP 2024.
- Program Chair forContinual AI Unconference 2023.
- Web Chair forACML 2022.
- Reviewer / PC member: CVPR (‘23, ‘22, ‘21), ICCV ('23), ECCV ('22), NeurIPS (‘24, ‘22), CoLLAs ‘23, AAAI ‘21, IJCAI (‘21, ‘20), ACML (‘22, ‘20)
- Reviewer for: IEEE Transactions on Image Processing, IEEE Transactions on Multimedia, Elsevier Pattern Recognition, Springer Machine Learning.