• 6 Posts
  • 649 Comments
Joined 2 years ago
cake
Cake day: July 1st, 2023

help-circle


  • It’s done on device, for the most part.

    Apple did explain the technology in a technical paper published on October 24, 2024, around the time that Enhanced Visual Search is believed to have debuted. A local machine-learning model analyzes photos to look for a “region of interest” that may depict a landmark. If the AI model finds a likely match, it calculates a vector embedding – an array of numbers – representing that portion of the image.

    The device then uses homomorphic encryption to scramble the embedding in such a way that it can be run through carefully designed algorithms that produce an equally encrypted output. The goal here being that the encrypted data can be sent to a remote system to analyze without whoever is operating that system from knowing the contents of that data; they just have the ability to perform computations on it, the result of which remain encrypted. The input and output are end-to-end encrypted, and not decrypted during the mathematical operations, or so it’s claimed.

    The dimension and precision of the embedding is adjusted to reduce the high computational demands for this homomorphic encryption (presumably at the cost of labeling accuracy) “to meet the latency and cost requirements of large-scale production services.” That is to say Apple wants to minimize its cloud compute cost and mobile device resource usage for this free feature.



  • That’s increasingly a not very nuanced or serious stance to hold given that actual journalists and columnists do publish on substack, especially those that are trying to break away from billionaire controlled “news sources” with owners that are actually interfering in editorial and reporting decisions. Do you remove all op-eds from your “news sources”? If not, you’re saying billionaire-controlled “news sources” are legitimate, but not independent journalists and columnists with actual bona fides, including having been part of establishment media or worked in government previously. The internet has destroyed journalism, seems wrong to tune out those who are trying to put it together again.