I ended up using interfacing everywhere to make it look more vest-y. The top torso pieces are lightweight interfacing and everything else is medium weight

I had to undo and redo things a lot and the struggle was real but I think it's passable