Emojis Kill Message Import

[garybarr]

So, we pride ourselves on getting back to people quickly with answers, so when we got this message saying they hadn't heard back from us, it was concerning all the way to the top.  

 

 

We didn't really see anything TO answer, it seemed more of a statement just letting us know what they did... until I logged into the email account and checked the email itself and saw there was a lot more to it, but since they had added a emoji, it looks like it stopped importing.  Above is what we saw, below is what she sent (missing info in yellow highlighter):

Since so many people use emojis anymore, this is a little scary on how many messages we only got part of their message.  

Is this a bug, or is there some way to stop this from happening?

 

 

 

[jdsnty]

I was facing a similar issue. I think it might be an issue with database configuration (default encodings, collation) since I've got slightly different results in different WHMCS installations (some truncated the message as Gary reported, others did not but rendered emoji as question marks).

The closest I've found to a solution is to enable the "Remove Extended UTF-8 Characters" option at Settings -> General Settings -> Localisation. As the name indicates, this removes any character outside Unicode's Basic Plane (anything with a code above 0xFFFF, including emoji), so even though the content will no longer be truncated, emoji will be missing (which can be a substantial problem of its own if you happen to work with emoji-ready domains but, for the most part, will be a lesser evil than randomly losing half of your client's reply).

[pRieStaKos]

https://docs.whmcs.com/Localisation_Tab#Remove_Extended_UTF-8_Characters
The right encoding for emojis is utf8mb4_unicode_ci.

[Attractive.Media]

On 12/18/2022 at 1:09 PM, pRieStaKos said:

https://docs.whmcs.com/Localisation_Tab#Remove_Extended_UTF-8_Characters
The right encoding for emojis is utf8mb4_unicode_ci.

Hey mate - I switched over to the recommended encoding, but my emojis still don't show up in my email template editor after saving - instead being replaced with "????"

Did I miss something? I applied the collation to all tables and columns...

Any further insight you can offer would be greatly appreciated. Cheers 🥂

[pRieStaKos]

You need to check the below:

- collation of database
- collation of table
- encoding of connection
- convert your test (column) to new encoding 

There are plenty guides through the internet for emojis (one here).