vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep
Article URL: https://blog.vllm.ai/2025/12/17/large-scale-serving.html Comments URL: https://news.ycombinator.com/item?id=46602737 Points: 109 # Comments: 28...
Article URL: https://blog.vllm.ai/2025/12/17/large-scale-serving.html Comments URL: https://news.ycombinator.com/item?id=46602737 Points: 109 # Comments: 28...
An internal product strategy document outlined Grindr's plans to expand its direct-to-consumer businesses. Spencer Platt/Getty Images Grindr aims to establish four successful direct-to-consumer busine...
I went to NRF 2026. Jordan Hart/Business Insider AI dominated this week's discussions at Retail's Big Show, a leading industry conference. I attended for the first time and saw retail leaders showcase...
The 46th Separate Air Mobile Brigade showcased a clip of a drone with a fishing rod-style device trying to take down enemy quadcopters. Red annotation by Business Insider. 46th Separate Air Mobile Bri...
Reddit's API is effectively dead for archival. Third-party apps are gone. Reddit has threatened to cut off access to the Pushshift dataset multiple times. But 3.28TB of Reddit history exists as a torr...
Alibaba Group Holding’s artificial intelligence strategy is defined by a commitment to open-source models, the company said on Tuesday, following a year of soaring adoption for its suite of AI service...
Final Cut Pro, Logic Pro, Pixelmator Pro, Motion, Compressor, and MainStage are still available as one-time purchases. Apple has announced Apple Creator Studio , a new software suite for Apple product...
Michael Dell, CEO and founder of Dell. John Lamparski/Getty Images Dell has told its employees to expect a companywide systems overhaul in May. Top exec Jeff Clarke told workers it would be the "b...
Stellar Blade director and CEO of Shift Up Hyung-tae Kim has stated that without the use of AI, developers in smaller nations will struggle to keep up with studios in places like the U.S. and China. A...
Around 10 percent of Meta's Reality Labs division, which develops its XR products and services, will be laid off beginning on Tuesday, as reported by Bloomberg . Meta spokesperson Tracy Clayton confir...
British Airways announced a deal with Starlink in November. Courtesy of British Airways Lufthansa is the latest airline to sign up for Elon Musk's Starlink WiFi. 31 carriers have announced deals for t...
Hi! I've built this because I kept reaching for Celery for simple scheduled tasks and it felt like overkill. I just needed "run this function every hour" or "daily at 9am", not distributed workers. So...
Verizon can keep phones locked to its network for longer after the Federal Communications Commission agreed to waive the carrier's 60-day unlocking requirement, as reported by Ars Technica . Following...
Haven’t you heard? Phones are boring now . And that’s just fine! Most people buying a new phone just want something familiar that works better than the device they’re replacing. If that’s your MO, the...
The Verge CES ground crew posing for a group photo in the Linq Promenade during CES 2026. We spent last week running to meetings, demos, and the convention floors to see as much as we could at CES 202...
Getty Images; Tyler Le/BI In-house legal teams are moving faster with artificial intelligence. Teams now have access to tools that draft legal documents and compare terms across deals. The efficiency ...
Most people in the U.S. needed to subscribe to Amazon Prime in order to watch the Chicago Bears/Green Bay Packers wild card playoff game. Cooper Neill/Getty Images For lots of people, NFL games are th...
Larry Hryb, better known to legions of fans as Xbox's former communications director Major Nelson, has reported being laid off from his new role at Unity. In a post on Twitter/X, Hryb shared an image ...
Audible's new Harry Potter full-cast audiobook series has already received its third entry. This new form of the Harry Potter books kicked off back in November 2025 with a unique interpretation of The...
JPMorgan's CEO Jamie Dimon Noam Galai via Getty Images This post originally appeared in the Business Insider Today newsletter. You can sign up for Business Insider's daily newsletter here . If you're ...