Ok, I picked up a brand new voltmeter, and I am getting readings now, although they are still confusing. The voltmeter is digital and has 3 ranges that I'm using: 20V, 200V, and 500V.
With the engine off the battery reads ~13V on all three ranges. With the engine on, the battery reads different...