vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-ep
Article URL: https://blog.vllm.ai/2025/12/17/large-scale-serving.html Comments URL: https://news.ycombinator.com/item?id=46602737 Points: 109 # Comments: 28...
Article URL: https://blog.vllm.ai/2025/12/17/large-scale-serving.html Comments URL: https://news.ycombinator.com/item?id=46602737 Points: 109 # Comments: 28...
Article URL: https://jobs.ashbyhq.com/legionhealth/ffdd2b52-eb21-489e-b124-3c0804231424 Comments URL: https://news.ycombinator.com/item?id=46603829 Points: 0 # Comments: 0...
Article URL: https://state-of-iranblackout.whisper.security/ Comments URL: https://news.ycombinator.com/item?id=46603910 Points: 42 # Comments: 12...
Hi! I've built this because I kept reaching for Celery for simple scheduled tasks and it felt like overkill. I just needed "run this function every hour" or "daily at 9am", not distributed workers. So...
Reddit's API is effectively dead for archival. Third-party apps are gone. Reddit has threatened to cut off access to the Pushshift dataset multiple times. But 3.28TB of Reddit history exists as a torr...
I went to NRF 2026. Jordan Hart/Business Insider AI dominated this week's discussions at Retail's Big Show, a leading industry conference. I attended for the first time and saw retail leaders showcase...
British Airways announced a deal with Starlink in November. Courtesy of British Airways Lufthansa is the latest airline to sign up for Elon Musk's Starlink WiFi. 31 carriers have announced deals for t...
Stellar Blade director and CEO of Shift Up Hyung-tae Kim has stated that without the use of AI, developers in smaller nations will struggle to keep up with studios in places like the U.S. and China. A...
Alibaba Group Holding’s artificial intelligence strategy is defined by a commitment to open-source models, the company said on Tuesday, following a year of soaring adoption for its suite of AI service...
Final Cut Pro, Logic Pro, Pixelmator Pro, Motion, Compressor, and MainStage are still available as one-time purchases. Apple has announced Apple Creator Studio , a new software suite for Apple product...
Michael Dell, CEO and founder of Dell. John Lamparski/Getty Images Dell has told its employees to expect a companywide systems overhaul in May. Top exec Jeff Clarke told workers it would be the "b...
An internal product strategy document outlined Grindr's plans to expand its direct-to-consumer businesses. Spencer Platt/Getty Images Grindr aims to establish four successful direct-to-consumer busine...
Around 10 percent of Meta's Reality Labs division, which develops its XR products and services, will be laid off beginning on Tuesday, as reported by Bloomberg . Meta spokesperson Tracy Clayton confir...
JPMorgan's CEO Jamie Dimon Noam Galai via Getty Images This post originally appeared in the Business Insider Today newsletter. You can sign up for Business Insider's daily newsletter here . If you're ...
Verizon can keep phones locked to its network for longer after the Federal Communications Commission agreed to waive the carrier's 60-day unlocking requirement, as reported by Ars Technica . Following...
January's list of PlayStation Plus Game Catalog additions has been leaked online, and includes Resident Evil Village . As ever, this month's additions have been leaked ahead of time by Dealabs ' relia...
The 46th Separate Air Mobile Brigade showcased a clip of a drone with a fishing rod-style device trying to take down enemy quadcopters. Red annotation by Business Insider. 46th Separate Air Mobile Bri...
A former veteran Bethesda developer has said the studio may end up with “hateful comments” even if The Elder Scrolls 6 ends up just being as good as Skyrim, which he considers to be one of the top 10 ...
Haven’t you heard? Phones are boring now . And that’s just fine! Most people buying a new phone just want something familiar that works better than the device they’re replacing. If that’s your MO, the...
The Verge CES ground crew posing for a group photo in the Linq Promenade during CES 2026. We spent last week running to meetings, demos, and the convention floors to see as much as we could at CES 202...