You may not erase a name of God that is written in chalk or other concrete but non-permanent substance (and certainly not if written in a permanent substance).
However, you can ask a non-Jew to erase it using a non-conventional method (shinu'i); for example, he may pour water above the name so that when the water runs across the letters, they will be dissolved.