That means that you collected your memory ember when you were standing outside of your property borders.
There is a warning available in the Memory Hearth description: "Memory Ember taken from it when you stand outside of the property bounds will not work for teleports!"