bobbyli-aus

[bobbyli-aus]

The hour I saved from not having to commute into the office during lockdown has enabled me to... commute into the office in virtual reality using google street view data.

A cadence sensor attached to the stationary bike crank transmits my pedaling movements to the Oculus Quest VR headset, which then stitches street view data together in real time to simulate a ride to work.

Given the lockdown-induced surge in home gym purchases around the globe, hybrid VR fitness solutions will undoubtedly help maximise value from these impulse purchases. Just need to look into the virzoom SDK to see if I can add tailgating motorists and jaywalking pedestrians to make it a genuine Sydney commute.

[bobbyli-aus]

Machine Learning for Human Emotion

I upgraded the smart mirror’s AI to be able to analyse human emotions in real time, which then uses this data to tailor its conversations accordingly. (e.g. if the user is angry then the AI assistant will tailor it’s language/phrases with a focus on calming the user). The AI is trained using FER2013, which is a dataset of 28,709 pictures of people displaying 7 emotional expressions, with its deep learning model based on a research paper title “Real time convolutional neural networks for emotion…” by O. Arriaga.

Tech-wise it is developed using Python, OpenCV, and a few deep learning libraries on top of tensorflow.

[bobbyli-aus]

VR Bushwalk

Stumbled across a cached page listing my one and only VR app previously published on the Apple Store and Google Play Store. The app had a good 2+ year run before I sunset it for archive. Commercial analytics showed a good distribution of users across the globe, particularly in France and Russia. I can only guess it is due to the cold climate up there.

https://appadvice.com/game/app/vr-bushwalk/1161239139

[bobbyli-aus]

Neurotech development

Spent a fascinating evening at a makerspace in downtown San Francisco. Got to collaborate on their neural lace prototype where my brain activities were streamed into a virtual reality environment via brainduino, WebVR and three.js and others were then able to explore and walk around in my brain via the Daydream VR headset.

The hypothesis discussed yesterday is that if you can accurately capture a person's specific brainwave when they are looking at a table, then if you inject a simulation of that brainwave into a person they should start hallucinating a table where there isn't one. YIKES...

[bobbyli-aus]

Helping elementary school teachers setup a music based science demo for year 5 students. All bananas were harmed in the making of this video, we ate them all to put them out of their misery.

[bobbyli-aus]

Voice controlled smart mirror

Built a voice controlled, facial recognition enabled smart mirror. Using Google Speech API for voice, LBWPT algorithm in Python for facial recognition and API.AI for machine learning.

Currently in talks with local nursing homes to trial this as a tool in commom areas to help calm residents with Alzheimer's.

[bobbyli-aus]

Converted the spare room into an indoor golf training studio. Sensors detect the clubhead speed and launch angle, and sends the ball trajectory data to the iPad via bluetooth, which then beams to the overhead projector.