File Deletion And Copying - Update Connection String

This is what I have for code:
Private Sub restoreDatabase(ByVal dbName As String)
Dim newDbName As String
newDbName = dbName.Substring(dbName.LastIndexOf("_") + 1)
My.Forms.portfolioGenerator.Close()
[Code] .....

It seems like it should be pretty simple, I take in a file name as a parameter, create a new name for it, delete it, then try to copy it back from an older version of the same file, and update the connection string. However, it continually tells me that "The file 'filenamehere' already exists." If I set overwrite to true then it goes through just fine, except it doesn't actually copy the file. Obviously I also check the folder, and the file does in fact Not exist...I've also checked all the file paths and what-not, they are all accurate.