Wednesday, December 20, 2006

The Pre-Insertion / Post-Insertion Punch List

There is a set of questions that recur as clients undertake their migrations. Since Exchange is a moving target and we are focused on the calendar data portion of it - we are providing this short punch list with links to make sure users find the most relevant info as quickly as possible.

Setup a service account

  • Ensure you have read/write, send-as permissions.
  • Check by using the following commands (in DOS at the command prompt) and drill down the path until you can enter into a user’s inbox :
  • Subst t: file://backofficestorage
  • Dir t:
  • Subst t: /d

Turn off handheld device servers

  • Otherwise your users are going to get lots of invitations they will not be wanting in the transition.
  • BlackBerry server documentation is here.
  • Good server documentation is here.

Check the configuration of your user accounts

The issues are:

  1. Mail Forwarding (altrecipient)
  2. Rules
  3. Calendar Message Management: Especially Delegates (aka Proxies in Meeting Maker, Designates in Oracle Calendar Server)
  4. Are users running in Cached Exchange Mode?
  5. If accounts do not validate - Is there an SMTP address alias@domain.com? Do you have adequate permissions?
  6. If you are not sure if you should migrate a calendar account, then MIGRATE the account! After a migration, it’s easy to delete an Exchange mailbox/cancel current meetings. It’s a huge amount of work to insert additional users (it really is as much effort as re-running the insertion).

Mail forwards (alt-recipient)

You don't want mail forwards enabled for the migration. If you have them enabled then users who are forwarded will not be correctly responded for. There are a couple of good Microsoft references on how to determine if an altrecipient is enabled.

Remove/disable RULES both Client-side and Server-side

Again, there is a good reference on how to do this: How to Use the Mdbvu32 Utility to Remove Inbox Rules

Delegates (setup; receives copies and forwards of meeting invitations)

  • In the latest version of the Sumatra Event Sink, if delegates receive COPIES they should be taken are of.
  • If some are still around, use the Sumatra Utilities with the /a: switch on that mailbox.
  • Do not allow the situation where delegates receive ALL invitations, this will leave all invitations unresponded to for that guest
  • Listing Which Exchange Users Have or Are Delegates is a very helpful collection of info.

Configure Resource Accounts

  • Setup your conference rooms as soon as possible. Keep them out of the GAL (so nobody can book meetings in a "land grab"), or disable the accounts until you’re ready to migrate.

Login/Access during migration

You don’t have to disable login, but you might want to strongly suggest that users remain off the system until all meeting invites have been sent and guest responses processed.

Exchange backup/logging/Cluster Fail-over

  • Although the Sumatra UNDO capability in the insertion code will selectively remove all migrated calendar data, we still recommend you run a backup (in production) immediately prior to starting an insertion to ensure the logs have been compacted.
  • In your TEST lab, turn on Circular logging if you don’t care about the losing the ability to restore from backups. This keeps the logs from eating all of your free storage.
  • In production DO NOT turn on circular logging. If you have to restore, any messages received will be lost.
  • Make sure Operations knows when the production/cutover weekend is. Make sure they do not fail-over the cluster during the migration process (we have seen this happen in real migrations).

Oops… I need to add a user marked as DROP

  • Talk with Sumatra about this. It CAN be done but there are limitations.

Remove the event sink ASAP after the migration is completed.

  • See your migration documentation.

Friday, December 15, 2006

Calendar Conflicts in Cached Exchange Mode in 2K3 sp2

Administrators universally agree that cached exchange mode in Exchange 2003 is a good thing providing added value and reliability to their infrastructure.

Programmers who write applications which interact with the calendaring functions unfortunately, are tearing their hair out and cursing their fates.


The situation:

We've built Rhino, an Exchange (server-side) solution to intercept and process calendar messages. The solution uses a synchronous an Exchange event sink. The event sink understands certain rules (via an XML file) that allow the system admin to :

  • Process meeting requests, replies, or both;
  • Skip managed resources;
  • Process requests as tentative, accept, or decline, and show the meeting as free, busy, or out of office
  • Process replies - keep/delete accepts/declines/tentatives or any reply with a reply from the end user.
  • All replies are processed to update the owner's tracking tab.

We manage the messages at the server side using CDOEX (version 6.5.7638.1) and EXOLEDB (version 6.5.7650.7) embedded within a synchronous event sink. This event sink works as designed when clients are connected to the Exchange server without Cached Mode.

The problem:

The problems that we are seeing is that the sink generates an Outlook Sync Issues "Conflicts" when clients use outlook in 'cached exchange mode'. i.e. clients see message on the meeting ... "You made changes to another copy of this item. This is the most recent version...."
Also when an Outlook meeting owner attempts to update one occurrence of the meeting, and changes the location, or adds an agenda, the meeting owner's calendar doesn't always get updated with the changes that he/she just made (e. g., the agenda gets lost, the location disappears from the subject line annotation in the calendar view, but still exists in the meeting detail view); and agendas are never received by the end user, until the meeting owner updates the same meeting occurrence twice.

Clients most frequently see this conflict message when they update meetings, or change a single occurrence of a recurring meeting.

What is going on here:

This is a bug in the ICS (Incremental Change System) for Exchange 2003 in cached mode.

Steps to reproduce:

  1. Create a Synchronous event sink in VB 6 using the event sink wizard from the exchange SDK.
  2. Add in code to detect and process calendar messages (see MSDN: http://msdn.microsoft.com/library/default.asp?url=/library/en-us/e2k3/e2k3/_cdo_processing_meeting_request_responses.asp
  3. Compile the code, register the event sink on your system mailboxes
  4. Create a recurring meeting using Outlook in Cached Exchange mode.
  5. Have that “guest” accept the meeting
  6. Open an occurrence of the meeting, and change the location, agenda, etc. Send an update, then switch to the inbox.
  7. Have the “guest” accept the update.
  8. Open the Guest’s response message (in your inbox)
  9. Switch to the calendar and open the meeting (you should see a conflict)

We've added the VB source code for main module as a comment to this post. The VB Project is available to those who request it.

Remedies we have tried already:

Microsoft support suggested their Auto Accept Agent that is implemented as an asynchronous event sink, but again you need to install this on every mailbox:
883130 The Auto Accept Agent Deployment and Administration Guide is now available
http://support.microsoft.com/default.aspx?scid=kb;EN-US;883130
903290 You should not register a resource mailbox for Auto Accept Agent in Exchange 2003 when you set up a resource for direct booking in Outlook
http://support.microsoft.com/default.aspx?scid=kb;EN-US;903290

Note: The auto accept agent is also an async OnSave agent.

Non-viable options:

  • Don't use cached mode with Outlook 2003 (This isn't an acceptable solution)
  • Asynchronous sinks (We tries these and it still generates conflicts, aside from which they need to be registered on each mailbox)
  • Direct booking (Really geared towards resource mailboxes)
  • Server-side rules could be set up to try to handle this (Again this would have to be implemented on every mailbox where we want this functionality -- more complex administration overhead)

Our solution:

We're implementing an Outlook best-practices client-side COM+ add-in for Outlook 2003 / 2007. Please feel free to contact us if you want to try it out.

Monday, November 20, 2006

Send As... permission and Exchange Hotfixes

For Rhino users and Sumatra Exchange Pump users, and Sumatra Utilities users, Microsoft's various post-sp2 Hotfixes for Exchange 2003 have been causing havoc with the Send As... permissions necessary to put calendar data properly into Exchange.

Good has the best summary we've seen of how to deal with this:

http://www.good.com/faq/17540.html

Wednesday, November 15, 2006

cdoEndByDate Broken

Usually we like to report things that can get fixed. But as we've discovered, fixes to Collaboration Data Objects (CDO) just are not to be hoped for.

We were attempting to create recurring banners in Outlook using CDO server-side.

As this sample code illustrates, the error comes from CDO directly.


Set oApp = New CDO.Appointment
oApp.Configuration = iConfg
oApp.StartTime = CDate("10/4/2006 10:00:00 AM")
oApp.endtime = CDate("10/4/2006 11:00:00 AM")
oApp.Duration = 1 * 60
oApp.Location = "My Cube"
oApp.Subject = "Test: Create Meeting in VB.NET"
oApp.TextBody = "Hello..."

' Add recurring appointment
Set iRPatters = oApp.RecurrencePatterns
Set iRPatter = iRPatters.Add("Add")
iRPatter.Frequency = CDO.CdoFrequency.cdoWeekly
iRPatter.Interval = 1 ' 1 hour from 10 to 11
iRPatter.DaysOfWeek.Add (3) ' every WED
iRPatter.PatternEndDate = CDate("10/25/2006 11:00:00 AM")
iRPatter.EndType = cdoEndByDate





Our recommendation: create them as non-recurring entities and inform users if they want to make them recurring. Since Outlook does not use CDO to interface with Exchange (ever wonder why Microsoft released CDO in the first place?) that will work.

Thursday, August 17, 2006

Migrating from Oracle Calendar Server to Microsoft Exchange while retaining recurrence patterns.

Oracle Calendar to Exchange -- Recurrence Pattern Recreation

When Sumatra reads Oracle Calendar Server data, it readily finds all of the instances of recurring meetings and activities – but the pattern created in OCS / CorporateTime is lost.

To make transition more seamless for the user community when moving to Exchange, Sumatra has developed methods of re-creating equivalent recurrence patterns and implementing these in Exchange.

While most recurrence patterns are simple and map readily, some of the patterns Oracle can create cannot be mapped into Exchange in any simple way – in these instances we insert the appointments or meetings as multiple instances with no recurrence pattern.

The following explains this in more detail.

Daily patterns in Oracle Calendar Server map easily into Outlook recurrence patterns.

Weekly Oracle Calendar Server patterns also map easily. For consistency, some “daily” patterns in OCS are translated into the equivalent “weekly.” That is – a “daily” OCS meeting that happens every 7 days is the same as a “weekly” meeting happening every “Tuesday.”

Monthly on Dates Oracle Calendar Server and Monthly on Dates in Microsoft Outlook are more problematical.

As you can see in the screen shots, OCS allows multiple collections od "by dates" or "by specific weeks."

We map these OCS occurrences if there is ONE of them per month. If there are two with the same title, we cannot translate them into an Outlook / Exchange recurrence pattern because Outlook allows only ONE such instance per month for a recurring meeting.

In cases where OCS has multiples (and our statistics show this is a rarely used condition relative to other recurrence patterns) we leave them as single instances.

Yearly recurrences map from OCS into Outlook / Exchange with no problems.

As always in migrations, there is usually ample time to work out special cases for client requirements.

Monday, March 20, 2006

Oracle Calendar In-Tray capability in Outlook 2003

Russ (in charge of the Exchange Insertion Team) has written a new article on how to mimic Oracle Calendar In-Tray capabilities in Outlook 2003.

Check it out at Outlook Exchange:

Thursday, December 22, 2005

Sumatra Utilities Update

Syntax:

su.exe /nd:xx /a /c /db /dn:domain /e /k:kwd /r /s /v:valfile /x /u:usr /in:infile

/out:outfile /h:holdat /tz:timezone

where:


/a =Accept pending meeting requests delete request

/b =Clear all booked meetings from calendar

/c =Clear pending meeting replies requests from inbox

/db =Check calendar for Double Booked mtgs/appts

/dn:domainname =Run SU on this "domain name "

/e =Output Every mtg/appt in calendar

/in:infile =user INput file, one AD alias per record (default infile.txt)

/u:user =process this User(supercedes /in:)

/k:kwdstem =limit mtgs/appts tagged with Keyword stem e.g. /k:ca finds ca,car,cat
(/k default:mmconv102659080256Z). Also assigns a category during an insert.
E.g., /k=holiday2006

/nd:xx =NDays to search (today-today+xx days), (max/default:15 days)

/out:outfile =Output file (default outfile.txt)

/r =limit to Recurring mtgs/appts

/s =show stats in popup message box

/tz:cdotzname =set timezone (use cdoName); default=eastern

/v:filename =Validate. Write valid users to filename

/x =Meeting CrossCheck

/h:holdat =Holiday data file (default fn holiday.txt)

/undo:mtgfilename =remove items from calendar (tagged w/ keyword)
If mtgfilename is present, remove only those meetings. Data uses the same format as the holiday file.

/qt =Remove outlook reminders from Outlook 2000 on Exchange 2000 only!

/rsvp:fix =sets “Request Reply” to true
/rsvp =shows meetings that have the Request Reply attribute set to false

Notes:
1. Must be run from the command prompt on a backend Exchange server
2. User must be an Exchange Domain Admin (service account), and have mailbox read/right authority

Not following the above two instructions is the biggest source of errors we see.


Command Line Examples


Output ALL tagged meetings for one user "riuliano" within the last 10 days into outfile.txt
su /u:riuliano /nd:10 /e /out:outfile.txt

Output tagged RECURRING meetings (only) for users in file "userlist.txt"(**) into bigoutput.txt
su /in:userlist.txt /r /out:bigoutput.txt


Find double booked meetings within the last 15 days in "userlist.txt"
su /in:userlist.txt /db /nd:15

Find double booked Recurring meetings within the last 15 days in "userlist.txt"
u /in:userlist.txt /db /r /nd:15

Find double booked meetings and show ALL meetings within the last 15 days in "userlist.txt"
su /in:userlist.txt /db /e /nd:15

Find mismatched meetings (cancelled in owner's calendar but not in conf. room;
different date/time) for resource "exec_cr"
su /u:exec_cr /x

Output all messages with keyword "mmconv" in this userlist to migrated.txt
su /in:userlist.txt /k:mmconv /out:migrated.txt


Clear meetings in calendar and meeting requests in inbox for all users in file "userlist.txt"
su /in:userlist.txt /b /c

Validate Users in the “test.sumatra.com” domain, and write the validated users into the “validinlab.txt” file
su /in:userlist.txt /dn:test.sumatra.com /v:validinlab.txt

Remove holidays defined in "holiday.txt" for for users in "usrlist" located in domain "lab.sumatra.com"
su /in:usrlist.txt /undo:holiday.txt /dn:lab.sumatra.com

Add holidays stored in the "holiday.csv" file to calendars “validated” in the lab in the “Sumatra.com” domain in the pacific timezone
su /in: validinlab.txt /dn:sumatra.com /tz:cdoPacific /h:holiday.csv

Ensure all meetings are have reply requested set to true for account “mairey” in the domain “lab.sumatra.com”, for meetings that were tagged with the Sumatra keyword
Su /u:mairey /dn:lab.sumatra.com /rsvp:fix /k



Notes:

All errors are written to the file "error.txt". Please check this file to ensure the utility worked without experiencing problems.

userlist.txt has one AD Alias per record

Holiday file is a "CSV" comma separated value file (The four columns are holiday name, start date, end date, and an optional fourth column holiday type. Holiday type is F,B,T,O for Free, Busy, Tentative, Out of Office. The default is "B")

Troubleshooting.

If you have appropriate permissions, are sure that the user mailbox is on the server you are executing SU.EXE on and get an error like this:


NELLZ WAS NOT Validated (User Does not Exist on this server) Url:file://./backofficestorage//MBX/NELLZ/

Then, re-run with the /DN:(domain name) switch.

Tuesday, February 01, 2005

The Sumatra Utilities for Exchange

The Sumatra Utilities for Exchange are tools for managing calendars in Exchange 2000/2003. You can insert holidays for users, or check for double-bookings, clear meeting requests, as well as several other functions. This tool grew out of our calendar server migration technology.

Syntax
su.exe /nd:xx /a /c /db /e /k:kwd /r /s /v /x /u:usr /in:infile /out:outfile /h:holdat

where:
/a =Accept pending meeting requests & delete request
/b=Clear all meetings from calendar (keeps appointments)
/c =Clear pending meeting replies & requests from inbox
/db =check calendar for Double Booked meetings/appointments
/e =output Every meeting/appointment in calendar
/in:infile =user INput file, one AD alias per record (default infile.txt)
/u:user =process this User(supercedes /in:) /k:kwdstem =limit mtgs/appts tagged with Keyword stem e.g.
/k:ca find ca,car,cat (/k default:mmconv102659080256Z)
/nd:xx =NDays to search (today-today+xx days), (max/default:15 days)
/out:outfile =Output file (default outfile.txt)
/r =limit to Recurring mtgs/appts
/s =show stats in popup message box
/v =Version
/x =Meeting CrossCheck
/h:holdat =Holiday data file (default fn holiday.txt) Note: Limits: 3,500 aliases, 1,500 mtgs/alias

Notes:
1. Must be run from the command prompt
2. User must have mailbox read/right authority


Examples

Output ALL tagged meetings for one user "riuliano" within the last 10 days into outfile.txt
su /u:riuliano /nd:10 /e /out:outfile.txt

Output tagged RECURRING meetings (only) for users in file "userlist.txt"(**) into bigoutput.txt
su /in:userlist.txt /r /out:bigoutput.txt

Find double booked meetings within the last 15 days in "userlist.txt"
su /in:userlist.txt /db /nd:15

Find double booked Recurring meetings within the last 15 days in "userlist.txt"
u /in:userlist.txt /db /r /nd:15

Find double booked meetings and show ALL meetings within the last 15 days in "userlist.txt"
su /in:userlist.txt /db /e /nd:15

Find mismatched meetings (cancelled in owner's calendar but not in conf. room; different date/time) for resource "exec_cr"
su /u:exec_cr /x

Output all messages with keyword "mmconv" in this userlist to migrated.txt
su /in:userlist.txt /k:mmconv /out:migrated.txt

Clear meetings in calendar and meeting requests in inbox for all users in file "userlist.txt"
su /in:userlist.txt /b /c

Add holidays stored in the "holiday.csv" file to these calendars
su /in:userlist.txt /h:holiday.csv