As you will see in my comment below, we struggle a bit to reproduce this:
The activity supports by default Files, Directories and Links, and anything other than this that is present in the folder will throw this error.
It would help us a lot to understand what objects could be causing this, but the information gather so far suggest that it only occurs for some specific type of SFTP servers.