With older version of windows like Vista and Windows XP, I tended to recommend people to stayed with the 32-bit version of windows, but now what about 64-bit hardware, software, and drivers?  With the new windows 7 we recommend that you at least look at the option of the 64-bit edition, windows 7 has more compatibility with hardware, better support and less problems with 64-bit applications. I do recommend this option for new computers; you do not need to go get a new version of the OS. Before getting the 64-bit you may need to check with the software that you normally use, if it is a business computer, please consult with the IT department, or call Computer Repair Zone for assistance.

32-bit – 64-bit
The terms 32-bit and 64-bit refer to the way a computer's processor (also called a CPU), handles information. The 64-bit version of Windows handles large amounts of random access memory (RAM) more effectively than a 32-bit system.

It is very important that your computer specification starts with the CPU; a 64-bit processor means 64-bit versions of the operating system, and a search for 64-bit drivers for peripherals.  Generally is my experience of software is that all applications that work on 32-bit processors also work on 64-bit processors.  However, there is a warning, many software manufactures don't recommend, or support, 32-bit software on 64-bit machines.  That said, some supply 64-bit versions of their programs, check with your software vendor.

Typical Problem with 32-bit application on 64-bit OS
The situation with Microsoft's own Office software is instructive, and typical of what to expect.  Microsoft supports this Office suite of 32-bit programs on 64-bit versions of Vista and Windows 7.  The only incompatibility problem is trivial; the internet fax does not work on 64-bit hardware.  Incidentally, when you install such 32-bit programs on a 64-bit operating system their files are stored by default under the 'Program Files (x86)' folder.
Read more about WoW64