ISNUMERIC function

I have a situation where I need to check if a row has all numbers in it before inserting into another table.Am using isnumeric() but the rows am inserting has some special characters and the isnumeric is returning true. Is there any other way. to check if all the digits are numeric?

Thanks