pull down to refresh

Who needs compute-hungry multiplications when you can just add logarithms

AI infrastructure startup Tensordyne has taped out its first commercial accelerator, with fabrication on TSMC's 3nm process already underway.

Developed in collaboration with Juniper Networks and Broadcom, Tensordyne's systems promise higher throughput and lower power consumption than GPUs. It claims to achieve this using an unorthodox approach to mathematics that uses logarithms – which you might recall from high school arithmetic – to make matrix multiplication heavy AI workloads less computationally intensive to run.

In conventional computing, addition is cheap, and multiplication is expensive. Logarithms flip this on its head. Using logs, multiplication essentially becomes an addition problem. a*b becomes log(a) + log(b).

...
0 sats \ 0 replies \ @Ohtis 19 Jun freebie -69 sats

Using logarithms to reduce the cost of matrix multiplication is a fascinating idea. Sometimes the biggest breakthroughs come from changing the way we approach a problem.