Bitget App
Trade smarter
Buy cryptoMarketsTradeFuturesEarnWeb3SquareMore
Trade
Spot
Buy and sell crypto with ease
Margin
Amplify your capital and maximize fund efficiency
Onchain
Going Onchain, without going Onchain!
Convert & block trade
Convert crypto with one click and zero fees
Explore
Launchhub
Gain the edge early and start winning
Copy
Copy elite trader with one click
Bots
Simple, fast, and reliable AI trading bot
Trade
USDT-M Futures
Futures settled in USDT
USDC-M Futures
Futures settled in USDC
Coin-M Futures
Futures settled in cryptocurrencies
Explore
Futures guide
A beginner-to-advanced journey in futures trading
Futures promotions
Generous rewards await
Overview
A variety of products to grow your assets
Simple Earn
Deposit and withdraw anytime to earn flexible returns with zero risk
On-chain Earn
Earn profits daily without risking principal
Structured Earn
Robust financial innovation to navigate market swings
VIP and Wealth Management
Premium services for smart wealth management
Loans
Flexible borrowing with high fund security
Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Tensormesh secures $4.5 million to boost AI server efficiency for greater inference capacity

Bitget-RWA2025/10/23 16:33
By:Bitget-RWA

As the demand for AI infrastructure skyrockets, organizations are under increasing pressure to maximize the inference output from their available GPUs. For those with specialized knowledge in certain methods, this environment presents an excellent opportunity to secure investment.

This is one of the main reasons behind the emergence of Tensormesh, which has just come out of stealth mode after raising $4.5 million in seed capital. The round was headed by Laude Ventures, with additional backing from angel investor and database innovator Michael Franklin.

Tensormesh intends to use these funds to develop a commercial offering based on the open-source LMCache tool, which was created and is maintained by co-founder Yihua Cheng. When implemented effectively, LMCache can cut inference expenses by up to a factor of ten—a capability that has made it popular in open-source projects and attracted collaborations with major players like Google and Nvidia. Now, Tensormesh aims to transform its academic achievements into a sustainable business.

At the core of this technology is the key-value cache (KV cache), a memory architecture that streamlines the processing of complex inputs by summarizing them into key values. In most conventional systems, the KV cache is discarded after each query, but Tensormesh CEO Juchen Jiang believes this practice leads to significant inefficiency.

“It’s comparable to a brilliant analyst who reviews all the information but forgets everything after answering each question,” explains Tensormesh co-founder Junchen Jiang.

Rather than deleting the cache, Tensormesh’s approach preserves it, making it available for reuse when the model encounters a similar task in a future query. Since GPU memory is a limited resource, this often involves distributing data across multiple storage solutions, but the payoff is a substantial boost in inference capacity without increasing server demands.

This improvement is especially impactful for chat-based applications, where models must repeatedly access an expanding conversation history. Agentic systems face a similar challenge, as their logs of actions and objectives continually grow.

While, in principle, AI firms could implement these changes themselves, the technical hurdles make it a formidable undertaking. Given the Tensormesh team’s expertise and the complexity involved, the company is confident there will be strong interest in a ready-made solution.

“Storing the KV cache in secondary storage and reusing it efficiently without degrading system performance is a tough technical challenge,” Jiang notes. “We’ve observed teams hiring dozens of engineers and spending several months to build such a system. Alternatively, they can leverage our product and achieve the same results much more efficiently.”

0

Disclaimer: The content of this article solely reflects the author's opinion and does not represent the platform in any capacity. This article is not intended to serve as a reference for making investment decisions.

PoolX: Earn new token airdrops
Lock your assets and earn 10%+ APR
Lock now!

You may also like

LTC - Drops 1.29% Following Earnings Outlook

- LTC Properties (LTC.N) fell 1.29% in 24 hours to $100.08, but rose 3.54% in 7 days and 4.92% in 1 month. - Analysts expect Q3 2025 earnings of $0.31/share and $33.19M revenue, a 40.5% decline YoY, with a "hold" rating from 8 of 8 analysts. - 12-month median price target is $37.00 (5.2% above $35.08), but LTC has missed 3 of 4 recent earnings forecasts by 23% on average. - Backtests show mixed post-earnings performance: -1-3% short-term returns (33-67% win rate) and 5-16% medium-term gains, lacking statis

Bitget-RWA2025/11/02 07:10

Bitget's 2030 Bullish Outlook vs. CoinCodex's Pessimistic Scenario: AEVO Faces Uncertain Volatility

- Bitget forecasts AEVO's 5% annual growth to $0.07686 by 2030, while CoinCodex predicts a 24.8% near-term price drop to $0.04353 by December 2025. - Technical indicators show bearish momentum (RSI 35.27) with critical support at $0.05444 and resistance at $0.06108 as key price levels. - Market dynamics include token unlock risks, regulatory uncertainty, and sector-wide trends like Eos Energy's recent 228 MWh order influencing AEVO's trajectory. - Divergent analyses highlight crypto market volatility, requ

Bitget-RWA2025/11/02 07:02
Bitget's 2030 Bullish Outlook vs. CoinCodex's Pessimistic Scenario: AEVO Faces Uncertain Volatility

Solana Meme Coin Whale Buys $VALOR with $4.6K

Top Solana meme coin trader returns, dropping 25 $SOL to buy 2.93M $VALOR — is another run coming?Solana Meme Season Veteran Makes Bold New MoveWhy It’s Getting AttentionShould You Follow the Whale?

Coinomedia2025/11/02 06:45
Solana Meme Coin Whale Buys $VALOR with $4.6K