How to create Excel (.XLS and .XLSX) file in C# without installing Ms Office?

Question

How can I create an Excel Spreadsheet with C# without requiring Excel to be installed on the machine that's running the code?