Technology

39102 readers

115 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.

Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.

Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 6 years ago

MODERATORS

MinutePhrase@lemmy.ml

Rockchip unveils RK3668 10-core Arm Cortex-A730/Cortex-A530 SoC with 16 TOPS NPU, RK182X LLM/VLM co-processor (www.cnx-software.com)

submitted 1 week ago* (last edited 1 week ago) by geneva_convenience@lemmy.ml to c/technology@lemmy.ml

5 comments fedilink hide all child comments

The RK3688 will come with eight big cores and four SMALL cores, while the RK3668 is offered in a four big cores and six SMALL cores configuration. The RK3688 also offers a 32 TOPS AI accelerator, up to 200GB/s LPDDR6 memory bandwidth, a 16Kp30 video decoder, and an 8Kp60 video encoder.

The second announcement I noticed, thanks to BG5SUN on X, is about the RK182X 3B/7B LLM/VLM co-processor.

It features a multi-core RISC-V CPU, 2.5GB or 5GB “ultra-high bandwidth” DRAM, and PCIe 2.0, USB 3.0, and Ethernet interfaces to connect to the host processor. The company indicates that INT4/FP4 7B parameter models can fit into 3.5GB of RAM. They are designed for the company’s Rockchip RK3576/RK3588 SoCs, already equipped with a 6 TOPS NPU, as well as other processors.

you are viewing a single comment's thread
view the rest of the comments

[–] BetaDoggo_@lemmy.world 2 points 1 week ago (4 children)

The bench numbers seem about right for 200GB/s bandwidth. The prefill speeds are really impressive for an SBC though.

[–] muusemuuse@sh.itjust.works 0 points 1 week ago (3 children)

I thought Rockchip said they were getting out of the SBC game after their chips were found in Russian drones.

[–] apt_install_coffee@lemmy.ml 1 points 1 week ago

Wasn't that OrangePi?

load more comments (2 replies)