Welcome to Gaia! :: View User's Journal | Gaia Journals

 
 

View User's Journal

Notes From Gaia
Random thoughts from inside Gaia
Development Update -- 9/1
Long Break
Sorry for the long silence. My vacation was nice, and I was very relaxed, but the problem is that I had all these requests stacked up during my vacation, so when I got back I had to deal with the normal set of requests + the requests over the vacation, which caused me to fall behind even more.

And, this explanation is startingly topical -- see below.

I'll get to my PMs over the weekend, I think -- my apologies to anyone who sent me something and has been waiting on a reply.

Gifting and Inventory
Gifting and some inventory changes will be out Monday -- they are in QA right now.

My Gaia
So we rolled out My Gaia. And pulled it out. And rolled it out again. And then just disabled the feeds. What the heck is the issue?

My Gaia is a heavy user of something that we call the "job system." The job system takes care of lazy evaluation of tasks that we don't want to deal with at the moment. We use this all over the place, especially for logging. Let's say that you've just completed a marketplace transaction -- we have to update the logs that keep track of the marketplace. But, there's no point in making you wait for us to update the logs, since it's okay if the logs are updated in 5 or 10 minutes, so we do something like this:

- complete marketplace transaction
- hey, job system: add (user id, item, price) to the logs

Now, the job system is running in the background, constantly waiting for jobs to be submitted, and when it gets one it will perform it -- so it sees the log request, does it, and then moves on. During periods of high load our job system will fall behind, but it almost invariably catches up -- it currently runs about 100 jobs per second on average.

So, My Gaia rolled out. It uses jobs extensively, every time you:

- post a message -- all your friends are notified
- change your profile -- all your friends are notified
- change your journal -- all subscribers are notified

... so on and so forth. Now, it turns out that there is a whole lot of activity going on in the site, so we suddenly saw the jobs shoot from 100/second to over 2000/second, which is more than were prepared to compensate for, and got us kind of into the situation that I was in with my vacation -- so much stuff stacked up that we couldn't get through any of it. So, we fixed some issues with the job system, fixed some issues with other data structures, tweaked some database stuff, and we're still running a bit hot, so we're trying to figure it out.

My Gaia, Philosophically
I've seen a lot of complaints about My Gaia, especially with regards to "stalking." I understand that sentiment -- I'd a strict privacy advocate -- but the other aspect to consider is that pretty much all the information on the feeds is also obtainable through other avenues on the site. I can search anyone's forum posts, I can just check their profile every day to see their comments, so on and so forth.

I think a privacy option -- i.e., the option to not have your information broadcast to the world at large -- is something that we want to do, but we'll take a look at it after we get the basic feed mechanism working properly.

Manga Mashups
If you look at the manga page now, you'll see that we now link to some of the mashup threads. You're going to see us doing a lot more of that in the future -- I think it's a really cool way to bring the community more to the forefront of the site.

Bugs Fixed (Past Three Weeks)
- fixed Fishing Hole link
- abbreviated the submission process for art so that moderators don't have to approve it
- minor UI tweaks all over the place
- new menus rolled out, which has been discussed to death in Site Feedback
- fixed the annoying problem with flash ads inserting into your history (so you needed an extra backspace to go back a page)
- fixed a problem with the forum polls vanishing sometimes
- changed the way we deal with popular items in the arenas
- auto-generation of suggested tags in arenas
- fixed it so you don't need to pay gold to edit an avatar arena entry
- fixed numerous problems in moderator tools
- tons of bug fixes in arenas






User Comments: [19] [add]
pirhan
Community Member
avatar
commentCommented on: Fri Sep 05, 2008 @ 08:07pm
Can't wait for the inventory changes. :3 I really hope you had a good vacation (went somewhere warm?) and I hope that all the muck ups here hasn't ruined your vacation happiness. heart


commentCommented on: Fri Sep 05, 2008 @ 08:11pm
Privacy options are absolutely necessary. It would, I guess, even make this frequency of jobs go down...
And... when is the game itens glitch be gone? It has been almost 2 months now...

Thanks for the update!
^^



Ketsushin
Community Member
Chocobo Princess
Global Moderator
avatar
commentCommented on: Fri Sep 05, 2008 @ 08:32pm

Hooray for vacation! And hooray for Journal updates! blaugh

A thought about feeds: I would prefer not to have my friends notified about every single post I make. This is not because I am embarrassed about what I've posted, but because most of it is extremely boring. Most of my friends and I are Q&A regs, and we each already know what the others have posted; we see it in the forum. I feel it would be redundant and annoying to have it also appear in the Feeds. And I post often when I'm handling the forum, so that could put quite a stress on the job system.

I also have a question about the job system: Is this overload the reason Marketplace Server Lag has increased from ~10 minutes to anywhere from 3 to 48 hours on transactions involving bidding? I seem to see a lot more queries about this in the Q&A since Item Norm, and I haven't seen it addressed in any other Stickies or Journals yet.

As ever, I appreciate the glimpse into Gaia you provide in your Journal. Welcome back! heart


commentCommented on: Fri Sep 05, 2008 @ 08:36pm
I agree with Chocobo: I think to a certain extent, the whole "oh no I'm being stalked!" thing is a tad silly. I mean, you're interested enough in these people to label them your friends...what exactly are they going to do with the knowledge that you bought a Monthly Collectible? Or that you posted in one of your favourite threads? It's not like they're broadcasting your address with the estimates on times you may be naked..
BUT....
When you post a lot (or conversely, you've got a ton of friends who are all very active), I can see the notifications going a bit overboard. So for me, it's not so much a privacy issue as it is a courtesy issue, you know?
Still, I can't wait to see the feeds in action. 3nodding


Oh, and it's super cool that you're linking to the comic edit threads on the official Manga page!



Gamine
Community Member
Lissianthus
Community Member
avatar
commentCommented on: Fri Sep 05, 2008 @ 08:56pm
Yay! Welcome back!

And yay for gifting and inventory changes!


commentCommented on: Fri Sep 05, 2008 @ 09:52pm
I still absolutely do not see the point of all those feeds. They seem like stalking at worst, and totally useless at best. Why not just... drop it entirely? You're obviously having a hard time getting it off the ground and the site clearly isn't relying on it.



Lazarus Larkin
Community Member
Smaddy
Community Member
avatar
commentCommented on: Fri Sep 05, 2008 @ 09:59pm
Welcome back!

I'm glad the Feeds are working. I think, like everything else, customization is key. We should be able to choose which overall feeds we want (ex: "View feed when new post is made in Subscribed thread? Y/N" wink , but then within the feed be able to choose more options (ex: "View feed in [Topic A]? Y/N" and so on for all Subscribed threads/friends, etc.).

Feeds could be really useful, so long as the right information is in there. View my Friends' posts... not very useful. Feeds on Journal updates, Marketplace pricing feeds, etc.

I'm glad to hear that inventories are being worked on. On a mule account, I can't remove anything from Storage, and all the Game item quantities are missing when I view my inventory (but the items are still there, like if I go to an Exchange in the Shops it shows the right amount).


commentCommented on: Fri Sep 05, 2008 @ 10:38pm
I would like to add that I like the feeds as well. This is how I knew that your journal had updated since I last logged on. I may not want to read every post of every friend, but this was quite helpful and I can ignore what does not interest me, like on a forum. I am hoping that gifting will be fixed before my daughter's birthday. That is the reason I am on Gaia in the first place.



amityhellcove
Community Member
France Hopper
Community Member
avatar
commentCommented on: Fri Sep 05, 2008 @ 11:17pm
Woo hoo! Feeds work. Odd that your journal update didn't pop up though. Then again, they just went up so I guess not really odd.

All the bugs that went out besides the new menus I don't think I've had a problem with. Good to know I won't have to worry about them in the future though.

Thanks for the update.


commentCommented on: Fri Sep 05, 2008 @ 11:35pm
Good to hear back from you again Panagrammic. Hope your vacation left you nice and rested.

So is the "job system" a seperate server or two, or is it a distributed load across all the servers?

Privacy is a concern of most people, but honestly, most of this stuff is already visible to anyone with half an eye left (or one and a half eyes removed, if you are in a negative state of mind). Yes, the feed makes it more noticeable, but how else was I supposed to know that friend X logged on for the first time in a month, made a thread in the RST, and skedaddled Y minutes later? I appreciate this ability of easier access of already visible information.

Caden: Well, Gaia released this because Site Feedback was running out of things to b***h about. All honesty.
But seriously, Gaia did this for the net benefit of all, including those who have an obsessive compulsive attraction to HAET. Because even you were a newbie once, and I bet you had a hard time getting used to the ropes. What better way than to make things easier and more coherent?



Kiyoske Dante
Community Member
Curisco
Community Member
avatar
commentCommented on: Sat Sep 06, 2008 @ 02:02am
Quote:
"I've seen a lot of complaints about My Gaia, especially with regards to "stalking." I understand that sentiment -- I'd a strict privacy advocate -- but the other aspect to consider is that pretty much all the information on the feeds is also obtainable through other avenues on the site. I can search anyone's forum posts, I can just check their profile every day to see their comments, so on and so forth."


Yea, but you must seach for them if you really want to stalk someone... it doesn't just pop up in front of you... Actually, I don't really want to know what my friends do around... it is their own businesses... So, that tool will be available only for us to hide our activity or not to know what people do around too?


commentCommented on: Sat Sep 06, 2008 @ 02:17am
Hmm interesting. Feeds died on me. The list isn't even there anymore. Just the whoops again.

Hey the captch's over nine thousand! 10,000 mountain



France Hopper
Community Member
Platonix
Community Member
avatar
commentCommented on: Sat Sep 06, 2008 @ 03:46am
Is there any sort of estimate for when the To Do list on the right can be customizable as promised? I'm waiting for both that and feeds before I consider the My Gaia page complete enough to judge how good it is.


commentCommented on: Sat Sep 06, 2008 @ 02:04pm
User Image - Blocked by "Display Image" Settings. Click to show.






I'm sure there will be some kind of privacy feature on the feed system. I know Facebook has this newer way of organization where you can allow certain people full access, others partial access, and everyone else no access at all.

But hey guys, if you're worried about stalkers, don't add just ANYBODY as a friend.



Morteana
Community Member
Chibi Halo
Community Member
avatar
commentCommented on: Sat Sep 06, 2008 @ 07:56pm
Wow took you long enough to personally say something about gifting again. I'm way skeptical it'll be back on Monday. We've heard Monday from you before and here we are over a month later and no gifting. Update 4 in your Feedback thread was the last thing you yourself mentioned on Gifting and it's left a lot of people sour about the communication on the site again. We shouldn't have to be relying on poor Sagger the economist of the site to tell us that yes someone is working on gifting because he doesn't work in programming. You made the Feedback thread you should have at least taken five minutes to update us on what was going on when it became a month since you promised a date for gifting to return.


commentCommented on: Sat Sep 06, 2008 @ 07:58pm
Could you mention to the web designer of Gaia to make more, fun layouts for Gaia? This one is all professional and bulky-business man like.

kay thanks 3nodding



a dog collar --
Community Member
Elliandra McTiernen
Community Member
avatar
commentCommented on: Mon Sep 08, 2008 @ 03:23am
Welcome back! I missed you! I'm glad you got time to relax =D

I'm really looking forward to the feeds, though I can understand how stressful it could be on the system! 2000/sec is a LOT of information O_o

I love the new MyGaia page, and I can't wait for more new features. =) thanks for all you do heart heart


commentCommented on: Mon Sep 08, 2008 @ 06:47pm
So that also explains the delay in some of the Marketplace transactions or is this an entirely different issue?

But I don't see the need of notifying your friends of every post you make. It may be useful for journals but there are too many posts being made every second for it to be of any use on the forums. The job system could clog up and eventually crash. And people with a lot of active friends could lose track of what their friends have posted. So I'd say: Strip the feeds down to journals and profiles only. That makes things a bit more manageable for the job system wink



Kamika Sugi
Community Member
xGHSL
Community Member
avatar
commentCommented on: Wed Sep 10, 2008 @ 06:41am
It would be really nice if you could update again and tell us what has been fixed because you mentioned how the inventories would be fixed by monday and it hasn't happened.


User Comments: [19] [add]
 
 
Manage Your Items
Other Stuff
Get GCash
Offers
Get Items
More Items
Where Everyone Hangs Out
Other Community Areas
Virtual Spaces
Fun Stuff
Gaia's Games
Mini-Games
Play with GCash
Play with Platinum