What is a FIPS Code and why do I need one?

Question: 
What is a FIPS Code and why do I need one?

The Federal Information Processing Standard (FIPS) code (FIPS 6-4) uniquely identifies counties and county equivalents in the United States. This is for FPDS-NG reporting.