Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

AZJonnie

(3,505 posts)
22. In my experience, it's really likely the issue is happening during I/O with the database
Wed Mar 4, 2026, 02:13 AM
13 hrs ago

In particular when data is pulled out of the DB and placed onto the DU form. When you're in "Preview" or "Edit" mode, what you're looking at (the text you're able to edit) has already made a round trip to the DB (your initial draft was saved to the DB IOW).

Now, that's also true when you just make a post and it shows up on the site (which is also reading posts from the database) but this a different sort of operation (using the web server) vs. pulling data out of the DB to enable editing (uses an app server typically, which is different software vs the web server).

The fact the problem only occurs when a post is edited by a user (but an UNEDITED post shows up fine on the forums) tells me the problem almost surely occurs when pulling data from the DB into the Editor. I'd expect something to the effect that the DB stores the data as UTF-8 (pretty sure DU is on mysql database, and some form of UTF-8 is default), the Web Server expects the same form of UTF-8, but the EDITOR expects a character set that's somehow different (could be a different UTF-8 version, of which there are a few, or maybe Windows).

They are sets that are LARGELY translatable seamlessly, but some characters (and smart quotes are notorious for this) don't translate perfectly, so we get these wrong characters show up in the Edit/Preview window, and then these 'wrong' characters save to the DB when the user updates, and then show up on the site as wrong.


Recommendations

1 members have recommended this reply (displayed in chronological order):

I was wondering that too Lifeafter70 18 hrs ago #1
Can you link to one? Renew Deal 17 hrs ago #7
It was earlier this afternoon Lifeafter70 17 hrs ago #9
In your browser menu canetoad 18 hrs ago #2
Thanks, I'm using Safari at the moment. Switch to Firefox for bigger jobs. nt eppur_se_muova 17 hrs ago #3
me too, since this afternoon on a thread I posted and on a very old post. bigtree 17 hrs ago #4
Is this the thread? Renew Deal 17 hrs ago #8
That was one I saw but there were others. Lifeafter70 17 hrs ago #10
Pasting one of the offending lines from that post: Renew Deal 17 hrs ago #11
Try editing that post and you'll see the issue AZJonnie 15 hrs ago #20
Just fyi ... Tasmanian Devil 16 hrs ago #15
On that page, I see the problem - I don't know what causes it. Jim__ 17 hrs ago #12
Could be tracking code that's getting passed through Renew Deal 17 hrs ago #13
You should re-post this in the DU Community Help forum. Wednesdays 17 hrs ago #5
Maybe you have a bad browser extension? Renew Deal 17 hrs ago #6
Unlikely, because Wednesdays 16 hrs ago #14
I had the same thing happen late this morning, when I cross-posted this thread highplainsdem 16 hrs ago #16
It's caused by editing or previewing, if you just paste into a post and post it immediately it displays correctly AZJonnie 15 hrs ago #19
It is happening with the 'curly' style single and double quotes like Word does, and it breaks in this way AZJonnie 15 hrs ago #17
If I tried to do a 2nd edit, the 2nd set of sentences would've gotten munged up as well AZJonnie 15 hrs ago #18
Thanks for working all that out ! I kind of figured it was a character set issue, and guessed 'smart' quotes ... eppur_se_muova 13 hrs ago #21
In my experience, it's really likely the issue is happening during I/O with the database AZJonnie 13 hrs ago #22
Thanks ! I've only done a very, very little C programming and know nothing about DBs, servers, etc. but ... eppur_se_muova 13 hrs ago #23
MS didn't invent the characters that are the 'curly' quotes AZJonnie 13 hrs ago #24
Latest Discussions»General Discussion»Why are apostrophes -- or...»Reply #22