Google is taking over my life

If you've been following my blog for a while you've heard various stories on my approach to mail and calendaring at home and at work. I'm now that the point where both mail and calendar for each are on Google Apps. I'm still not there on address book or chat, but its definitely heding in that direction. I also started using Google Chrome and its actually real competition for Safari. Firefox never had a chance with its long load times. 

So now comes the big question: If you're using web apps, why use desktop clients to access them? This week I made the jump and went to the extent of making Fluid apps for google mail and google calendar, giving them the same icons as the Apple mal/cal icons and removing the regular apps from my doc. I'm still learning the idiosynchronices of the google interfaces, but so far so good. 

When I travel i'll have to revert to imap or try the very early Google gears on OSX, but there are options.

Its hard to beat free, especially if the free stuff is doing a good job (and in some cases better than the paid stuff). 

Google is slowing winning me over. I don't agree with all their choices, or how they've handled data and data management but starting to take sips of their cool aid. I dont buy that they'll replace desktop OS's with web applications anytime soon. There's just too much data (video, pictures, music etc) and too much need for offline access in todays world, but they will win on some key fronts like email.

OSX Server = FAIL

Ok, after a year of trying hard to make OSX server work for our small business (< 20 employees) i've given up. Stop reading here if you don't want the gory details.

OSX Server just doesn't work and is not ready for prime time. The straw that broke the camels back was Calendaring. We're at at point at the office where calendars and shared calendars HAVE to work. We moved to Snow Leopard server with the hopes that that update fixed calendar issues... It didn't. Internally, after the upgrade, things were great, we should share and view each others calendars. But the issue was when we tried to get invitations from people outside or send invitations to outsiders we couldn't add the invitations, people couldn't open our invitations etc. When you combine that with other calendar things like not being able to control which email account the invitations go out from it was a total disaster. 

On top of the calendar issues we saw mail getting hung up in the queue when spam filtering was enabled so we had to turn that off. Running without a spam filter, even a mediocre one, is really painful. Then there's the whole issue of a lightweight interface to DNS etc.

We thought about just using google calendar for calendaring and keeping mail the same and limping along with spam issues, but then found out that unless your invites etc arrive at the same email address (including domain name) that the calendar is at then google calendar doesn't do well with it -- invitations get confused, not added etc. So both email and calendar have to be at the same address/domain for google apps.

We looked at 2 options: Go to Exchange or try Google Apps again. Exchange is proven in very large businesses and can do it all. But its not cheap (we guessed about $20K for us to deploy) and would take time to deploy and migrate. We could go the hosted approach but still had migration issues plus the loss of control over our data. If we're letting someone else have some of our data then a hosted solution for exchange versus google apps is probably equally risky. 

So what we decided to do was go the Google Apps approach. Perhaps this will only buy us a little time or perhaps it will last for quite a while, we'll see. Essentially we changed all mail to flow through the Google Apps domain but then forwarded it on to a sub-domain for the users that don't need the calendar support. By creating all the accounts first at google and forwarding all the mail to the subdomain we essentially changed all the users over without them being involved -- the mail just flowed through google. Then for the users that need calendars we unforwarded the mail and now new mail comes into and stays at google. Here are the exact steps:

1. Create Google mail/cal setup @ domain.com (google apps)
2. Add mx records for sub.domain.com
3. Rename domain.com -> sub.domain.com on your current mail server
4. Create all users @ domain.com (google)
5. Adjust domain.com mx to point to the new google apps setup
6. Forward all mail from domain.com to sub.domain.com (so the move is transparent. Note there's a window between 4 and 6 where a few emails could come in so watch out. Google doesnt let you add users and forward mail until your MX records point at them)
7. Move desired people back from sub.domain.com to domain.com by disabling forwarding and giving them their google passwords

Note that step #3 with the OSX mail server was non-disruptive to the users. We essentially changed their email addresses from user@domain.com to user@sub.somain.com without them knowing or changing their clients. Thats because on OSX server you auth with just the username and password not the full email address. That was a nice trick that avoided a lot of noise for the team.

Why not just move all users to google mail (i.e. no forwarding)? Because Google has some oddities in the way they behave as a mail server. Their labels vs. folders is one, the limit on how many clients for the same account can connect at one time is another. The data being offsite/in their hands is another.

The result?

You could literally hear the joy from the people now having working calendars. It just works and was night and day better than Apples iCal server. On top of that Google is eating spam as one of the best spam filtering services on the planet. 

While I have my issues with Google Calendar, if you can avoid the issues it does the job well.

So now that we're not using OSX server for calendaring and most of the heavy (and less technical ) mail users are off on google, we're not very dependent or tied to OSX services. We're going to move to a tried and true Linux-based DNS, DHCP and Dovecot mail setup. No fancy UIs to undo our work or hide power and functionality.

If you're thinking about OSX server -- DONT. Its a waste of your time and money. Start with Google Apps and when you grow out of it move to Exchange (hosted or not based on your security/financial constraints)

If you're following this blog to learn about OSX server, stop now. I'm taking it out back and putting it out of our misery.

Google Calendar very broken

Back in June 2008 I wrote about a nasty problem with Google calendar where it reminded me and others about events on a calendar I had deleted. Well, since almost 2 years have gone by since I disabled calendars on my google apps domain (crickers.com) I tried it again. And guess what? It immediately reminded me of events on a calendar that didnt exist.

Searching around on the net shows this to be a real problem for others too. What bothers me most is that there's data for me that exists in google that has triggers to do things to me and other people that I have NO access to. 

The solution? Shut off google calendar for crickers.com again. Just means my home calendars have to be hosted elsewhere.

But do you really own and control your data when its on google? It would seem not from the evidence.

iPad?

Being the Apple fan that I am you may be wondering if i'm going to get the iPad. Despite the blog, i'm not a consumer of everything Apple produces. While products like the Lisa, Newton, AppleTV and others were innovative in ways, they show that Apple doesnt get every product right and there's a cost to their consumers for their learning. I bit on the Newton but skipped the Lisa (used it at work) and so far i've resisted AppleTV. So what is the iPad?

Normally i'd skip this one too. I either want something very small that fits in my pocket (iPhone) or a full blown computer (MacBookPro 13" or MacPro currently). Something thats too big for my pocket and not good enough to do everything isnt a fit for me.

But it just so happens my daughters PowerBook 12" is finally on its last legs. Its wireless broke years ago, its got a CD jammed in the drive, the batteries are all shot and she's beaten it to death. My wife inherited my MacBookAir but only uses it for facebook and email from various rooms in the house (mostly just before she goes to sleep). So i'm faced with upgrading the kid to a new Mac or using this as an excuse to get the iPad. Move the wife to the iPad, the kid to the MacBookAir and they'll both be happy and I get a new toy to play with. Seems like a plan, we'll see.

Meanwhile, my thoughts on this whole netbook/tablet craze is that it all just has to go away. The thing I want is a full computer/OS that fits in my pocket and has all my data. Then I want to wirelessly attach it to keyboards, mice, monitors wherever I go. That way my computer travels with me and is always with me and I avoid syncing data everywhere, getting used to new interfaces, etc. All these other products are just killing time until the technology can get there. 

Of course there's the alternate reality approach where Google has all your data and applications and you just use a web browser to get at it all. I dont drink that cool-aid. While online apps have come a long way and you can even get REAL games online now through a browser, I think we'll get to the real portable computer before everyone hands their data over google to take care of for us.

BluRay and OSX

Apple has yet to add native BluRay support to OSX. You can use Roxio's Toast Titanium with a $20 add-on package for BluRay to burn disks. Saving away 50GB at a shot is very nice but the disks are still $13+ each. The 25GB disks are a more reasonable price of $2-$3 each. 

Reading the BluRay disks is another thing. With a combination of MakeMKV (currently in a time-limited beta) and Handbrake you can copy/convert BluRay disks to a different format and with assistance from MakeMKV and VLC you can watch them by following a process that is outlined here and summarized below:

1) Open bluray disc in Makemkv and then click Stream.

2) Click http://192.168.0.180:51000 (for instance) to open your default web browser.

3) Navigate to the title, something like http://192.168.0.180:51000/stream/title0.ts

4) Then paste that link in VLC in the File | Open Network (command N) in the URL section and voila watch your bluray on Mac directly off the bluray disc in VLC.

5) Do not try to stream or play in Firefox or Safari it just won't work.

I confirmed all the above works although its all a bit touchy in terms of the quality of VLC and MakeMKV.

Your alternative is a long conversion process, or just go play them in a PS3 or other standard player. Steve Jobs evidently frowns on BluRay.

Been quiet, what have I been up to?

Hi everyone, i've been quiet over the last several months as work was crazy. I don't talk about work much except where it things from there relate to the Mac etc. But if you're interested, check out www.nasuni.com.

Needless to say, there's lots of Mac, Python, backups, storage and other fun things going on with a killer group of people.

Snow Leopard Server

So as you can tell from previous posts, we moved from Leopard Server to Snow Leopard server. The move wasn't without a TON of pain. The hope was that things would be significantly better on the new version. Some things (unlimited client licenses) are better, but most things are just.. different.

There's still plenty of signs that its a mostly untested piece of software from apple. The fact that there's a button in the mail configuration to enable antivirus but when you push it it doesnt work shows that basic testing hasn't been done. If you run into this, as we did, you can find solutions online.

There are other annoyances/totally broken areas, i'll list a few:

• Groups don't work as mail distribution lists anymore. Not sure how they broke this, but they did
• Calendar invites from outside your domain do not go to your domain calendar, and if you try to copy/place it on the right calendar you get: The server responded: "HTTP/1.1 403 Forbidden" to operation CalDAVWriteEntityQueueableOperation.
• You still have to hack the server to enable RADIUS for VPN authentication. Apple has it fixed to do wifi auth and didn't think this through
• Mail aliases still are not supported so you still have to sudo vi /etc/aliases in the terminal to manage these. Then you need to deal with any races in it overwriting on its periodic updates as you edit the file
• They have not thought through the whole internal versus external naming/conventions around their web mail/management interface to the point that its almost impossible to make use of

Thats just the list from the top of my head. The main point being that if you're thinking about using OSX Server for your business, and as much as it hurts me to say so, i'd say don't and go use Exchange. Sure its more expensive, harder to manage, etc, but the thing works and Microsoft, unlike Apple, seems to care about it.

Leopard Server = No Time Machine

In upgrading from Leopard Server to Snow Leopard Server our IT consultant made the assumption that Time Machine had his back on the upgrade. Generally Time Machine was backing up the Leopard server, but what wasnt obvious until we poked around in the backups is that on Leopard Server it does not backup mail. I had previously looked into mail backup and had mailbfr installed, but it hadn't run recently as he prepared for the upgrade. Apple fixed this major deficiency in Snow Leopard and now mail is indeed backed up with Time Machine on Snow Leopard server. 

It makes you wonder though, Apple claims to be making business class servers and software. They include their own backup software, but it has a major omission around mail backup. This is just another point that apple is not serious about running the servers for businesses.

OSX DNS issues

Is your mac behaving oddly with regards to DNS in that its not honoring the DNS server? I found out the hard way that apple, with its mDNSResponder service, broke tried and tested DNS on OSX. There are plenty of places on the net you can find this mentioned and its surprising and frustrating that Apple hasnt fixed it yet. Anyway, if DNS is behaving oddly on your mac, start with:

sudo killall mDNSResponder

It will restart itself and refresh DNS.

Google Voice - not moving?

I was excited by Google taking over Grand Central, I thought it was finally going to start going somewhere. There were some short term changes but after that... nothing. Google for many years behaved like a startup and its products and ideas moved quickly. In recent years Google has begun to stagnate with fewer changes around the applications it delivers to the consumers and more focus on monetizing its work. Sure, thats not surprising, they have to make a living. Buts its a shame that they had to slow down their innovation so much as they chase the precious dollar. Google Voice is just one more example of google slowing down. Disagree? Let me know.

Where'd I go?

Sorry folks, things got crazy all over. No, they're not less crazy yet, but there's a bit of light at the end of the tunnel. Its been fun though. Anyway, i'll try to catch up on some pending blog entries. Thanks for sticking with me!

I was at an airport recently for a delayed flight and on the laptop. The thing started cooking my lap. I looked and saw that spotlight was busy indexing my hard drive while I was on battery. This seems like a simple, "if on battery dont update spotlight" decision. Battery life is precious enough, to waste it for spotlight seems like a poor decision. Its a wonder some poor decisions like this last for so long in software.

Disqus

Switching over to Disqus for comment system for the blog. Let me know
(those few that comment!) if it bugs you.

DNS over VPN and Snow Leopard

Since upgrading to Snow Leopard DNS hasn't worked on VPN. A friend suggested a:

sudo killall mDNSResponder

And sure enough that fixed it. Poking around I found others suggesting that it gets scripted up to get killed every 60 seconds.

The fact that this helps and the fact that companies like Parallels have knowledge base articles on it would lead one to believe Apple should be fixing it.

At least the workaround is known until Apple gets in gear.

Call blocking

I have to say that i'm having a blast with Google Voice. No more
spammers and once I identify them from the "missed calls" log (since
no phones ring if they're not in my address book) I can block them so
they get the tone of disconnect. Love it, sweet sweet revenge on the
spammers.

iPhone 3.1 woes update

Since my last entry on the misery i've had with iPhone 3.0 i've made some progress. After much fiddling I found that turning off things like wifi, bluetooth, MobileMe, etc did not solve my problems.

The one symptom I could see is that with all accounts deleted and MobileMe sync turned off I still saw calendars listed in the iPhone calendar app:

Nothing I did (reboot, power off, reset) would get rid of them.

I resorted to the ultimate and completely nuked the phone and set it up like a brand new phone. This is a horrifically painful process since you have to re-lay out where your apps are, re-enter passwords/settings for each app etc. Perhaps a restore would have worked but I had read reports that it didnt and didn't want to do the 2 hour wipe part more than once.

The process worked. I've been good for 4 days and i'm declaring victory.

There are still some reports that even with Calendar sync off in iTunes people are seeing calendars "on my iphone" that they cant get rid of. I think the bug exists but there are some manifestations of it that are catastrophic like mine and others that are just annoying.

Regardless, for Apple to not have fixed it quickly is inexcusable. Their self-inflicted punishment appears to be giving people new iPhone 3G's unnecessarily.

ScanSnap 510M and Snow Leopard

One of the many casualties of Snow Leopard, the ScanSnap S510M software got crippled with this update. ScanSnap is an oddity to me. Such a great scanner and such poor software and support by Fujitsu. Anyway, the ScanSnap software broke in an odd way. You cant "Scan to Folder" but you can "Scan to Print". Fujitsu posted the chart of what works and what doesnt. So my new workflow is to "Scan and Print" but then from the printer settings box, do a "Save as PDF". One extra step but essentially it recreates what I had before things broke and my Scanner is functional.

Shame on Fujitsu for not fixing this before the Snow Leopard release or shortly after. Double shame on Apple for breaking so many things with a featureless release.

iPhone 3.1 Woes

Since i've upgraded to the 3.1 OS on the iPhone my iPhone has been frustrating. Its slow to respond, takes forever on key presses, battery is draining quickly, etc. Looking around the net shows that others are experiencing the same thing. The general solution appears to be don't turn on wifi and bluetooth at the same time although others are suggesting more drastic measures. I'll give the wifi/bluetooth settings a shot and see how it does over the next day or so and report back. 

Seems like a basic test case. Perhaps they used the team from Snow Leopard? Or are they just giving us grief for not upgrading the the 3GS? Of course if they had offered early upgrades...

Mint and Intuit

I wrote a while back on my blog why I chose Mint.com over Quicken
Online and I guess Intuit is paying attention. I'm glad to see them
recognizing this and picking up the cool team at Mint.

For the record, Quicken for the Mac STILL has not been updated and
since they don't have an Intel version wont even run on Snow Leopard.
I say fire the group and get some startup to start over, it will be
cheaper and better. Look at Mint.

Snow Leopard - wait it out

I pre-ordered Apple's latest OS, Snow Leopard and got it the day it
came out. Thanks to some FedEx fiasco's I didnt install until the next
day but I think I still qualify as an early adopter. I have to say i'm
seriously disappointed. The quality and compatibility is poor. Worse
than any other release i've experienced from Apple. Here's some of
what i've seen:

1) Many applications are incompatible and not yet updated. Perhaps you
can blame developers for not being on top of things, but I think not.
I expected PPC apps to have an issue as this is an intel only release,
but I was shocked at the number of apps that broke even though they
had intel support. Here's a short list:

Medialink, EyeTV, Growl, ScanSnap, 1Password, Contribute, and many more

Why did so many apps break? Why didn't apple warn people in advance?
The upgrade from PPC to Intel machines was smoother.

2) I've seen several "black screen of death" events where I must power
cycle the machine. I was perfectly stable before that. For the record
the machine I saw that on I did a complete wipe (disk format) and
fresh install of Snow Leopard and then only installed the latest
versions of apps I needed. Can't blame some less tested upgrade path
for that one.

3) I've had many hangs in Mail and Safari where I have to force quit
the apps. Didn't have those issues before the upgrade. This is a fresh
install, Apples apps and basic ones. Quality Control?

4) We've seen some odd behavior -- VPN to work using Apple's native
VPN to a Cisco firewall worked great before Snow Leopard. After the
upgrade DNS doesnt work. You can connect but you cant resolve anything
on the other end so you end up having to edit /etc/hosts and add
systems by hand. How'd they brake that one? And why? (multiple people
have experienced this)

5) Some vendors, like the Agile folks, makers of 1Password, have
chosen to use this as an opportunity to charge for an upgrade and not
support you unless you upgrade. Considering i'd owned 1Password for
less than 10 months I was shocked to see them require me to pay for an
upgrade. On all other fronts the Agile team is amazing but this
decision is flat out wrong. Others have gone down that route and
you'll be paying for upgrades to apps that worked fine prior to Snow
Leopard. The OS may be cheap ($29) but the time sink and the apps you
have to pay to upgrade are not.

So i've had issues, what about the good stuff? Um, what good stuff?
Frankly I haven't noticed a performance improvement and the
frustrations of a semi-stable OS wipes that out anyway. There are a
few very minor visual improvements, but fundamentally almost nothing
is noticeably different.

Its too late for me now, but I wish I had waited 6 months+ to upgrade.
Not the normal experience with Apple.

Home Media Servers

The battle has been raging for a while on who owns a device near your TV. My bet is one of the consoles is going to win as they have the video quality, compute power etc. A while back I remodeled my family room and since I didnt have much time at the time I hired a company to do the sound piece. The speakers etc worked out fine and i'm happy. What i'm not happy with is that they installed a Control4 unit as the controller for the whole system. There's an attached drive to load media on. This system is dated by today's standards and you can't make any configuration changes without calling a dealer to support it -- yes you cant manage a device you own. Some day i'll rip it out of my system and get a better approach. What a waste.

Anyway, using it for video playback doesnt work, it supports music (poorly) and pictures (also poorly) (perhaps the $250+ software upgrade would make things better but im not going to find out). Basically anything you do with it costs serious money which means it has to go.

I got a disk of the first season of 24 for Christmas and I wanted to watch it but not be feeding disks to my playback device constantly. I had the idea to rip the disks and then do video-on-demand within my home. I already have Cat5e cabled networking and a GigE switch between the major computers and my family room so bandwidth wasnt an issue. I had the ripped files and needed a way to serve them to the TV. I use my PS3 as a DVD player since my old DVD player died and as it also does the BluRay disks too. Unfortunately the PS3 disk is tiny. 

I looked around and found MediaLink which turns a mac into a media server for the PS3 (They have a version for the XBox 360 too). That works great, I can now browse my pictures, music and video from iTunes, iPhoto or on folders on my drives and play them back on the PS3. The PS3 could use better menus/controls but it works and the software was $20.

So now my video library is on a TB hard drive in my basement and streams to my family room when I need it sure beats the DVD shuffle.

Only problem is Snow Leopard broke it. See next blog entry.