- Notifications
You must be signed in to change notification settings - Fork4
MobileNet on TensorFlow.js - label images from Unsplash in browser
License
emadehsan/marsjs
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
Marsjs is the browser client for Mars@Home. Currently this extension labels image fromUnsplash in browser - using MobileNet on Tensorflow.Js. It is available onFirefox addons site andChrome web store.
InstallMars@Home for FirefoxInstallMars@Home for Google Chrome
Clone this project
$ git clone https://github.com/MarsAtHome/marsjs
captioner
: Contains MobileNet & TensorflowJs code for Image Labelingextension
: Contains code of Chrome Extensionimages
: Screenshots & media files for the READMElogo-files
: Logo files forMars@Home
Go to
about:debugging
in FirefoxClick
Load Temporary Add-on
, select any file from insideextension
folder from cloned project
Go to
chrome://extensions/
in ChromeTurn ON
Developer mode
Click
LOAD UNPACKED
and select theextension
folder from cloned project
Check the Current task by clicking in your browser's url bar
Taken straight fromtfjs-converter MobileNet model is served from Google Cloud as 4MB chunks and is cacheable by browser.
The model takes 224x224 image, so Unsplash images are fetched in 224x224 size withcrop=face
URL parameter.
After changing files incaptioner/mobilenet/
, run
$ cd captioner$ rmdir dist; # OR rm -rf dist$ parcel build mobilenet/index.html
Parcel must be installed globally.
Copy all files exceptindex.html
fromdist
toextension
directory. Copy the content ofdist/index.html
and paste it inextension/popup.html
title & subtitle. Remove old code pointing to old build after pasting.
On clicking the extension appears as a box of 300x600. Shows the link to current photo being processed. Once the labels assigned, shows top 3 labels with their Confidence score on the left.
Mars@Home says it's a public volunteer computing project committed to solving real life problems. Then why the first client labels images instead of"computing climate simulations"?
With this first version, we want to find out thatwould people participate in a modern volunteer computing project for real life problems? Keeping that in mind, we designed it so that, with other things, it has a small fun element to it. We wanted maximum people and developers to join the movement. Because the real development is yet to happen!
BTW I have to confess that building this project was such a joy! But watching the MobileNet model assign labels to beautiful Unsplash photos was equally entertaining. So here's more
- Star this repository :)
- Do add your email at →https://marsathome.org if you believe in the effort!