I had an old Honda trail bike with a similar issue. I sanded and polished it out really well. I know it's not an MX bike, but it's still going strong.
It might only pass over that spot for split seconds at a time so chances are low it will severely impact the oil levels, but keep an eye on it...