Conforming loans are those that satisfy the criteria that Fannie Mae and Freddie Mac set regarding what kinds of loans they will buy. Besides certain credit-related guidelines like debt-to-income ratio, one major constraint is the maximum loan amount. Barring any upcoming changes (see below), the current limits are $417,000 in the continental US (AK, HI get $625,500).
Because they can be so readily sold to these psuedo-government entities, conforming loans are usually very competitively priced. Non-conforming loans have to be sold elsewhere or kept in-house, so they usually end with higher rates. But as recently as July 2007, the added cost for a non-conforming loan might have been only 0.20%. However, due to rising default rates and skeptical investors, the premium is currently around a full 1%. This has led to the increasing popularity of replacing a jumbo loan with two loans - a conforming one and a second loan to make up the difference.