Insulate the exterior with exterior basement insulation

Create a moisture barrier on the outside of the masonry or concrete.

I recommend: Both Owens Corning and Dow Building Systems manufacture rigid foam insulation you can use on the exterior of the basement wall. This exterior basement insulation comes in a "fan-fold" configuration, which allows for easy installation. This helps to create a moisture barrier as well as increases the R-value of the basement wall.

Insulate the interior walls with interior basement insulation

Seal the inside of the basement walls to keep in the heat by keep out the moisture.

I recommend: Find basement insulation for the interior walls with OvrX Manufacturing and Total Basement Finishing. Both have rigid foam panels for the interior walls to help not only provide a moisture barrier and help retain the heat, but also finish the walls. More traditional finishing includes batt fiberglass insulation.

Use insulated blocks for basement insulation

An insulated foundation helps to retain the heat and keep out water.

I recommend: Two companies that manufacture insulated blocks are Superior Walls and Seaway Wall Distributing. Insulated blocks help create effective basement insulation. The walls are impenetrable by moisture and have a good R-value. If you combine these walls with insulation on the interior wall, and on the exterior, you will not lose heat through the basement.