I don't understand the issue. This works for me:
SELECT Table3.ID, Table3.Field1, Replace([Field1],",""DUMMY""","") AS New
FROM Table3;
NOTE: I've deliberately included 2 records that don't work.
ID=1 fails as there is no comma; ID=4 fails as there is a space after the comma
Check that neither of these apply in your case