How do I tell if it's really Ivory?

Take it to an expert - like a pipe maker.

Be aware that there are many restrictive laws addressing the transport, sale and ownership of ivory.   There are better choices for responsible materials in the market today.  A good pipe maker may be able to help you.