Founder, CEO at Archetype AI. Tech leader and executive, interaction designer, scientist. Google, Disney, Sony before. 2019 National Design Award. TED speaker.
Spatial interface our team developed last year: whatever you are holding in your hands defines the meaning of your actions, which can be translated into the digital realm. For example, to find out more about an object you're holding you can simply come closer to see better... 🧵
Soli radar gesture sensor that we invented and have been working on for last 5 years here in ATAP will be a part of the upcoming Google Pixel 4 phone! Google has just announced it.
A personal update: I am excited to announce Archetype AI, a deep-tech company that I co-founded with a dream team of designers & engineers.
Our team has incredibly diverse experience in bridging the physical world and advanced computation, particularly artificial intelligence.
We started project Soli 5 yrs ago as an impossible idea: to build a radar-based touchless interaction sensor, small enough to fit into a smart watch or smartphone.
Today it was announced as as a Motion Sense in Google Pixel 4:
@madebygoogle
@GoogleATAP
It would be somewhat ironic if after nearly 40 years of research, development, multiple hype and bust cycles, it is COVID19 pandemic that might push broad adaption of spatial interaction, free space gestures and virtual reality.
My Vision Talk, 'Ultimate Interface' which I presented at the
@ACMUIST
2023 conference last week, is now available online!
In my talk, I proposed future interaction design paradigm where interfaces are not designed by humans, but generated by AI in
Nice blog post about Soli, radars and human-computer interaction by
@nickarner
who was an active member of our early Soli developer program that we launched with the very first version of Soli sensor and software toolkit.
@GoogleATAP
#UX
#radar
One of our very early experiments with Soli. We tried to use it for controlling a little character in the game: when it runs fast enough it turns into an airplane and then you can control how it flies. It was fun.
@StudioNAND
@jonas_loh
@GoogleATAP
Wearable gesture controller that we built last year with Soli radar allows for swipe up and down motions, as well as a single pinch to select. This device turns your hand into a 2D directional
#joystick
@ctrlzee
The tools we have always limit us in what we can imagine and create. The power and the purpose of inventing new technologies is not just to make something useful now, but to break through the boundaries of our imagination and create a better tomorrow.
I am a bit surprised that FCC waiver approval for Soli got so much news coverage. Do people follow FCC filings or is there just dearth of positive tech news? Anyway, Fast Company called me "a legendary interaction designer" which is nice
There is one book that inspired me to do what I am doing now. When I was 19 growing up in the USSR I got a copy of "Hackers" by
@StevenLevy
. The idea that "things" can be hacked and their nature can be changed by inventing new technology inspired me for the rest of my life.
Project Soli that we invented in ATAP is featured in Google Design's Best of 2019.
This annual yearbook rounded up over 20 Google projects that exemplify brilliant human-centered design. See who else made the list!
@GoogleATAP
#design
It was fantastic giving a vision talk at
#UIST2023
yesterday, answering numerous questions, and engaging in some enlightening debates afterward. I hope it served as a source of inspiration and will spark thoughtful discussions about the future of
#PhysicalAI
and interaction.
As I always say: one day they want you to be are a visonary, think outside the box, disrupt and do things differently ... and the next day they ask you where is your 5 years P&L.
It was a tremendous honor to receive 2019 National Design Award in Interaction Design yesterday at the Gala at Cooper-Hewitt Smithsonian Design Museum in NY.
#NDA20YRS
@cooperhewitt
Soli was just launched in the Nest Thermostat! It's used to detect users and activate the product. Because the radar can "see" through materials, Soli allowed for uninterrupted beautiful mirrored finish, without a cutout for a motion sensor
@GoogleATAP
To celebrate the launch of Jacquard 2.0 and our collaboration with Saint Laurent we also launched our new and thoroughly redesigned Jacquard web site:
#JacquardByGoogle
@GoogleATAP
Every idea, hypothesis, pitch or process proposals should answer "What, How and Why" questions. Over the years I have observed that people tend to focus on "What" is that they want to do, expect someone else to figure out "How", and pretty much no one bothers about "Why".
I am honored to be a keynote speaker at
#chi2019
conference in Glasgow.
ACM CHI is the premium venue for the latest research on everything related to interaction technologies and interaction design. I am looking forward to be inspired by new work presented at CHI!
We have our first confirmed
#keynote
speaker for
#chi2019
: The amazing Ivan Poupyrev! Find out more about
@ipoupyrev
here: We're aiming for a diverse and exciting line up - watch this space for further announcements.
Really excited to give a Vision Talk at the UIST 2023 Conference! Does that officially qualify me as a visionary now 🤔?
UIST stands for "User Interface Software and Technology," and it's really the top academic conference for innovation in human-machine interaction.
On Monday Oct 30th, Ivan Poupyrev (
@ipoupyrev
) will give a Vision talk “The Ultimate Interface” on what emerging AI architectures could mean for interaction. Come to UIST2023 to see it!
Back from Vancouver after giving talk at
#TED2019
. It was an incredible experience to talk at TED, but it was also the process of working with TED curatorial and speaker teams that was important and valuable. It helped me to think about about my work in the whole different way.
I still can not fully internalize that I won 2019 National Design Award in Interaction Design category. This is a huge honor and an incredible group of other award winners to be part of:
@cooperhewitt
#NDA20YRS
Pixel 4 teardown by iFixit, shows Soli chip. From review: “TL;DR: magic rectangle knows your every move”
A bit of overstatement about "every move", but I myself can't help but marvel at how small & simple Soli has become over the years.
@GoogleATAP
Get ready for Archetype A01, our fine tuned multimodal LLM with 13B parameters! 🚀 It's running on our own A100 cluster and can summarize short video segments, just like
#ChatGPTv
but for temporal image sequences. Stay tuned for more updates on A01
@PhysicalAI
. 1/3
Very well put: "Apple’s work here comes from a long lineage of experiments ... from work out of Carnegie Mellon University to Google’s Project Soli radar, which let you control the watch with gestures in midair. Ultimately, everyone in the field has been asking the same
Jacquard by Google is going global!
Second version of
@LEVIS
Trucker Jacket based on new Jacquard 2.0 platform was launched in the US, Germany, Italy, France, Australia, Japan!
@GoogleATAP
Available in select stores and on .
We started publishing after being focused on shipping products for the last couple of years! This upcoming
#CHI2021
paper presents some of our ML work for gestures with Soli radar developed for Pixel 4 phone. Honored to get Best Paper Award!
@sig_chi
#interaction
#design
Early in my career I was warned against overcomplicating things. "Your goal as an inventor" I was told "is to reduce the complexity of your ideas until they fit on a bar napkin". "Well, how?" I asked. "Remove as much information as you can, but not too much". "Genius!" I thought.
"Motion Sense" touchless interface released in Pixel 4 made it into Popular Science's 100 Greatest Innovations of 2019! Motion Sense is of course based on Soli radar interaction technology that we invented
@GoogleATAP
:
#Soli
Was teaching my daughter how to change batteries in her magic princess wand. Hoping this is her first step to becoming an electrical engineer!
#Disney
#electricalengineering
It was great to collaborate with
@golan
and his students from
@CarnegieMellon
who used Soli Sandbox and Google's Pixel 4 phone to create some pretty impressive prototypes!
#Creative
#hacking
These circles are obviously static and neither move nor change shape. Visual illusions are interesting because they demonstrate bugs in compression, motion estimation, interpolation and image stitching algorithms that our brain performs from the imperfect input our eyes provide.
Its was observed before that throwing more people at a problem often results in decreased team performance. It seems paradoxical, but its not: the cost of scaling a team is decreased productivity of its individual members. You can call it a "Scaling Law".
Excited to announce Soli Sandbox
@GoogleATAP
, a simple way to create Javascript prototypes with Soli interactions running on Pixel 4! Anyone can create with it using JavaScript, so set your ideas in motion with
#solisandbox
!
Start here:
At "Made By Google" event two weeks ago myself and Shenaz Zack from Google Pixel team shared vision for mobile interfaces and creation process behind "Motion Sense" interface launched with Pixel 4 -- the first commercial use of Soli technology.
(2/2) In this
#TED
talk I discuss in significantly more details the history, philosophy and vision behind Jacquard computing platform and how it can radically change our everyday things that we love, use and wear everyday.
Google Design runs an article written by Soli and Jacquard interaction designers on the vision and philosophy that underlines our quest for interfaces that would "... give our devices a new kind of awareness—something akin to emotional intelligence".
(1/2) In this exclusive interview with CNET we are discussing the Jacquard 2.0 "smart things" ambient computing platform that we have just launched last week
#JacquardbyGoogle
@GoogleATAP
I wrote a short piece about ambient computing, future of wearables and Jacquard platform for the official Google Blog "Keywords".
@GoogleATAP
#JacquardbyGoogle
"Work, finish, publish" was an advice by Michael Faraday to a young scientist when asked about the secret of his success as a scientific investigator. It is still a pretty good advice.
Problem definition is 50% of any research, technological invention, or scientific discovery. Once you have defined the problem, preferably in mathematical terms, then the fun part of the research is kind of over. The rest is execution, which is when real work starts.
Arrived
@chi2019
conference in Glasgow, apparently there are more then 3000 papers presented this year across 14 parallel tracks! Incredible. Giving closing keynote on Thursday.
The winter break is over & 2020 is on! The next decade. The outgoing 2019 was quite consequential for me. We've done a lot. Many of the "impossible" ideas I started working on in the last decade came out and shipped in 2019. My top 10 highlights from 2019 … (1/11)
@GoogleATAP
Looking forward to giving a keynote at
@SIGGRAPHAsia
next month!
@siggraph
conferences remain some of the best venues to see the latest deep tech advances happening on the intersection of graphics, interactivity, HW and AI. It's always incredibly inspirational!
@GoogleATAP
#tech
Join
@ipoupyrev
from
@Google
as he brings us through his explorations of the present & future where tech, connectivity & intelligence are woven into the very fabric of our lives. It will take place on 10 Dec, 11am, SGT/GMT+8. 𝗥𝗲𝗴𝗶𝘀𝘁𝗲𝗿 𝘁𝗼𝗱𝗮𝘆: !
I was thrilled to announce Archetype AI at the
#SynapseAISymposium
, organized by
@bendingspoons
, where I showcased early demonstrations of the Physical AI technologies we are building. We will be sharing some of our demonstrations at
@PhysicalAI
very soon.
It was an exciting
Hot off the press interview with two best and probably most thoughtful interaction designers in the world: Jack
@schulze
and Timo
@timoarnall
. It was amazing to work with them in the early of days of Soli.
We
@GoogleATAP
have been working for nearly year to understand how Jacquard smart apparel and "smart things" can help young adults with physical disabilities to live better, more independent lives. The video below tells some of the story.
#accessibility
Found this WSJ article talking about smart clothes that quotes me and
@GoogleATAP
work on Jacquard. Published in January 2020, it was a very different world back then! Nice article though. via
@WSJ
#Wearables
#WearableTech
Certain things, often the hardest ones, can be only discovered, learned and understood by doing them. I have been looking for a quote expressing this thought eloquently, this is one by Aristotle “For the things we have to learn before we can do them, we learn by doing them.”
Had an amazing hour-long chat with the
@HapticsClub
podcast crew. We looked back at the behind-the-scenes stories of the haptic projects and products I worked on, such as the tactile touchscreen with custom-built piezo bending motors I built
@SonyCSL
, electrovibration tech aka
Obsession about "perfectly made" isn't just about toasts in Japan, its one of the underlying qualities in Japanese culture, you can see it in many things from tea ceremony and kabuki, to capacitors, camera optics, games, cars and architecture.
I got this book by an accident. In the USSR one could not buy US books freely. My father, a Soviet mathematician, met fellow US mathematician at a conference in the DDR who gave him "Hackers" with an inscription "To know the country, is to know its heroes". This was its cover.
Presenting Jacquard platform and Levi’s product at
@sxsw
Innovation Award Show. And to celebrate SXSW, Levi’s offers 30% discount for the jacket during the festival. Code is JACQUARD30.