I was aiming to use LLMs with robotics in an upcoming project, and needed to first verse myself in what is the current must-know techniques in the space. To that end I read a ton of papers and wrote this article to try and suss out the best parts of current state of the art.

I hope this helps people; I'd be thrilled to discuss much of this as well!

I was aiming to use LLMs with robotics in an upcoming project, and needed to first verse myself in what is the current must-know techniques in the space. To that end I read a ton of papers and wrote this article to try and suss out the best parts of current state of the art.

I hope this helps people; I'd be thrilled to discuss much of this as well!

A cool application of RLHF (Reinforcement Learning w/ Human Feedback - the same approach as what OpenAI used to train ChatGPT).

The authors trained an agent to fly FPV drones at a level surpassing world champions.

I have argued for awhile now that the probabilistic nature of LLMs can represent a form of context that, when applied, can be utilized for robotic applications.

Seems I'm not the only one that had this idea. While simple, Microsoft researched applied a high level control library to demonstrate LLMs (ChatGPT) developing robotic task code.

ROS maintainers discuss popular robotics control and navigation algorithms in use within ROS2. The associated discussion can be found here.

If you're looking for what to study or try applying in your own projects next, this is worth a look.

This is the routine thread where we discuss what you'll be working on this week! A cool robot? A computer vision project? Something cool in reinforcement learning? 3d printing a drive train? Let us know!

Maybe instead you're studying something, or reading a paper that just came out? Post about it!

It’s also okay to say “nothing” too - it’s great for your mental health to take a break!

Looking for help? Ask a question! See someone working on something cool? Ask them about it! No project is too small or too "newbish"!

What is a San Diego community without an appreciation for our sunsets?

Pic taken on my phone - was biking around and made my way to the "off ramp" next to Scripps Pier for a nice shot.

And a bit earlier at the same spot...

Playing multiple co-op campaigns, and every druid across multiple campaigns experience, randomly, unexpected deaths when being knocked out of wild shape. Not death saving throws either - straight into full blown d-e-a-d.

Per the rules, it should go from wild shape -> spill over damage being removed from the remaining HP of the druid. Reading the combat logs we see that while enough damage is done to knock the druid out of their wild shape, the remainder is not nearly enough to put them into death saving throws, let alone outright kill them.

Is anyone else encountering this issue?

In my first attempt at a long form technical post, I talk about a project where I had to use deep reinforcement learning to try and solve a robotics application. It worked ok - the post talks about my struggles, solutions, and what I'd change up in the future.