Advanced
Vitalik Buterin@vbuterin
7/10/2023

Device-to-device audio communication (think QR codes, but made out of sound) seems very underrated. Much better UX than QR codes or NFC because you don't have to worry about putting your phone in the exactly right place or pointing it in the right direction. Anyone here with more detailed takes on this?

In reply to @vbuterin
Vitalik Buterin@vbuterin
7/10/2023

I feel like there could be a lot of crypto wallet applications.

In reply to @vbuterin
gigamesh@gigamesh
7/10/2023

Embedding crypto signatures in audio sounds very fun. I’m imagining R2D2-like conversations or call & response melodies.

In reply to @vbuterin
leoclark.⌐◨-◨ 🛡️@leoclark
7/10/2023

A developer friend of mine was working on exactly that many years ago. I will find out what happened.

In reply to @vbuterin
Nandit Mehra@nanditmehra
7/10/2023

think about D2D shazam

In reply to @vbuterin
Nandit Mehra@nanditmehra
7/10/2023

shazam easily identifies the song playing. Its a good starting point to think about this https://www.shazam.com/home

In reply to @vbuterin
0xLuo@0xluo
7/10/2023

Non-expert personal opinion: Audio communication is susceptible to interference, especially over longer distances. If devices need to be in very close proximity, why not go back to NFC? Perhaps using Bluetooth or WiFi that many devices already have could be a more general choice.

In reply to @vbuterin
shukudai.dayo.eth 🌹☀️@shukudaidayo
7/10/2023

Maybe something like an OpenDime for ETH, that may not have a display for a QR code, and that you wouldn't want to hand to a counterparty for them to scan an NFC to validate the contents? Instead, the counterparty's mobile wallet can transmit a nonce, and the OpenDime can respond with its address and a signed message.

In reply to @vbuterin
indy@indy
7/10/2023

Google tried using audio communication technology for pairing with ChromeCast (https://gigazine.net/gsc_news/en/20140627-chromecast-ultrasonic-authorization/). Not sure why they stopped using this.

In reply to @vbuterin
Leo Simon@leo5
7/10/2023

Beacon technology also seems underrated to me. You can give a free mint to anyone who enters a store and have a specific app downloaded. Could be great for rewards programs.

In reply to @vbuterin
Jonathan Shomroni@shomroni
7/10/2023

Should be outside of human (and dog) spectrum so it doesn't annoy anyone

In reply to @vbuterin
Aron@aron
7/10/2023

Some physical store tried this almost 10 years back. Walk in to a specific section of store, install app, will capture Audio signature and give rewards. Kids recorded the audio clip being played and farmed 😂. Idk it seems QR code is much cheaper for places like India. Audio will need an emitter as well. Cost.

In reply to @vbuterin
Duffy@duffy
7/10/2023

Interesting, but I think the world is noisy enough already :(

In reply to @vbuterin
Colin Johnson@colin-
7/10/2023

I’m imagining the entrance to a stadium sounding like a pond full of frogs as everyone passes through the turnstiles 🐸 🔊

In reply to @vbuterin
j3@j3
7/10/2023

Imagine getting drained because your phone heard an invisible sound frequency

In reply to @vbuterin
Canada@canada
7/10/2023

Sort of like fax machines communicating out loud and in person...

In reply to @vbuterin
7/10/2023

I actually tried to build this with a friend a few years ago. We got a POC, but basically hit a roadblock when we started looking into how lossy/low fidelity speakers and receivers were. It's been a while, tech might've caught up by now.

In reply to @vbuterin
Dan Romero@dwr
7/10/2023

Sonos uses an audio pin to pair a new speaker and your phone.

In reply to @vbuterin
MC Faceman @faceman
7/10/2023

would that be more or less vulnerable to hacking 🤔

In reply to @vbuterin
nir.eth 🌿🟣🐦☁️@nir
7/10/2023

Any good examples out in the wild?

In reply to @vbuterin
bagelface.eth @bagelface
7/10/2023

i also miss the dialup sounds

In reply to @vbuterin
7/10/2023

Hllo vitalik. Thanks

In reply to @vbuterin
Varun Srinivasan@v
7/10/2023

It would be ideal if you could do it in the high frequency range. Then you could play it on loop and have a really nice UX. But if I remember right this is lossy and it’s very hard to get the error correction right.

In reply to @vbuterin
sgt_slaughtermelon@sgt-sl8termelon
7/10/2023

Is that not precisely what is getting exploited in this scene from Hackers:

In reply to @vbuterin
vrypan.eth@vrypan
7/10/2023

Is this the 80s all over again? When people would broadcast computer games by playing the tapes they were on, over pirate radio?

In reply to @vbuterin
vrypan.eth@vrypan
7/10/2023

It might be interesting to check the history of CueCat. https://web.archive.org/web/20001017162623/http://www.businessweek.com/bwdaily/dnflash/sep2000/nf20000928_029.htm (scan for "audio" in the article.) For some reason I have the impression that Amazon bought them eventually.

In reply to @vbuterin
7/10/2023

android has a nearby api that use ultrasonic sound to communicate in this way.

In reply to @vbuterin
Rebecca Rose@rebeccarose
7/10/2023

Could be useful for setting verbal agreements into stone via smart contract. No more risk with conflicting memories or gentlemen’s agreements.

In reply to @vbuterin
benrwms.eth@benrwms
7/10/2023

10 years ago the Chirp app seemed really promising in this space ... alas, it didn't make it. RIP Chirp! https://www.youtube.com/watch?v=kLaFpq5fvlM

In reply to @vbuterin
7/10/2023

Seems like the tech could create scenes from Japanese anime where characters control robots using flutes to launch attacks.

In reply to @vbuterin
0x1000@0x1000
7/10/2023

I’m more concern about security of this

In reply to @vbuterin
Max Branzburg@max
7/10/2023

We built this for payments in India on low-end devices, enabling peer-to-peer and merchant payments. App was initially called Tez and is now called Google Pay India. It works! https://www.theverge.com/2017/9/18/16325004/tez-google-india-audio-qr-cash-payments

In reply to @vbuterin
dcposch.eth@dcposch
7/11/2023

would love to try it. NFC works amazingly in apple pay--smoothest, fastest experience i've ever had transacting. unfortunately not possible for in-app P2P transactions due to apple restrictions. NFC uses "device" (tapper) & "card" mode (tapped). Android can do both, iPhone apps are only allowed do the former.

In reply to @vbuterin
sanket@sourcex
7/11/2023

How would it work in a noisy place?

In reply to @vbuterin
Dan Kahn@dankahn
7/11/2023

Older fintech ppl will remember this as the original Clinkle pitch!

In reply to @vbuterin
7/11/2023

Fax machines and dial up?

In reply to @vbuterin
Pierre Pauze @pierrepauze
7/11/2023

Are there any examples of applications that already exist? Curious to try this out in art exhibitions.

In reply to @vbuterin
7/11/2023

Only if it’s in super sonic dog tones. The animal planet gonna get wonky

In reply to @vbuterin
Buuvei@buuvei
7/11/2023

I can see AI voice imitation. Also if you say something by mistake somewhere or there is hidden voice device, might give accidental access to it

In reply to @vbuterin
7/11/2023

They had something similar in Japan when I was living there before smartphones were a thing, in 2008-2009. Basically, you would ask your phone to exchange contact details with another, and hold their wireless sensor next to the other phone's sensor, and boom, done. It was a nice social ritual too.

In reply to @vbuterin
7/11/2023

Think I’ve seen something like this from google where you could send a link via a sound, was quite a cool little feature.

In reply to @vbuterin
July@july
7/11/2023

I built an app that did this about 10 years ago that did offline TXs. issues we ran into: - poor microphones at the time on android meant (iPhones were fine) we were relegated to them - there’s a lot of noise in the world - bit rate on audible sound spectrum is slow

In reply to @vbuterin
Joe Blau@joeblau
7/11/2023

12 years ago I worked on a using multiple sensors called "Proxignos" — I know horrible name. The idea was to use multiple mobile sensors to statistically improve probability that two devices were in the same location using GPS, accelerometer, camera, a 5 second audio clip, and device time.

In reply to @vbuterin
Amir@link3
7/11/2023

Vitalik when eth dead?

In reply to @vbuterin
Carlos@solana1
7/11/2023

I’m putting ear muffs on my phone when I go out now

In reply to @vbuterin
7/11/2023

My understanding is that this was a key feature for early Zoom adoption. Pre-covid their video conferencing software was seamless in the office. You’d always share to the correct screen, easily join the current meeting, etc. And seems they way they did it was with sound.

In reply to @vbuterin
Branksy Pop @branksypop
7/11/2023

In this app whistling 2600hz should shut down the phone though. JustForFun

In reply to @vbuterin
Vinex @vinex
7/11/2023

Likeee vitalik

In reply to @vbuterin
abranti@abranti
7/11/2023

What are the pros/cons of sound vs bluetooth?

In reply to @vbuterin
Aloshvalosh@aloshvalosh
7/11/2023

I think it's an interesting concept and could be useful in certain situations.

In reply to @vbuterin
7/11/2023

Yes, especially if sent on a high frequency. Someone should do a general sound frequency analysis of cities and areas. Would be helpful in figuring out the efficacy of such a system.

In reply to @vbuterin
7/11/2023

Data you can put through this would be tiny given audio is up to 20kHz and WiFi is 2.4-5GHz. Perhaps good for authentication or one-time actions but not for streaming.

In reply to @vbuterin
0xChris@0xchris
7/12/2023

Radio industry uses a sub-sonic frequency with a SMPTE-like timecode to measure listenership. Think QR audio as a never-ending radioprint for FM stations. This is the foundation of Nielsen PPM.