Are there more detailed direction on to do this with excel?
Might have helped is you had included a more detailed description of what you are trying to do.

You can import and export lists of recommended links from Zoom. We would suggest using a text editor (like Notepad or UltraEdit) if you think you need to do external editing.

The format for this is in the help file.

However if you want to use Excel, then you need to use pipe separators instead of the standard commas for CSV format. One easy way to do this is to change your windows regional settings (in the Windows control panel) list separator from a comma to a pipe character.