woensdag 28 december 2011
Open Source BizTalk Projects in Codeplex
dinsdag 13 december 2011
Ports that DBAs Need to Know
Service |
Type |
Port# |
Comments |
Default Instance |
TCP |
1433 |
Official socket allocated by IANA to Ms for SQL Server, this can be changed to anything above 1024. |
Named Instance |
TCP |
XXXXX |
As & what you assign in the dynamic port range. There have been changes since Win 6, see below for the available range. |
DAC Default Instance |
TCP |
1434 |
Remote connections through DAC are disabled unless turned on manually. For named instance ports other than 1434 are used. |
SQL Browser / SQL Server Resolution Protocol |
UDP |
1434 |
Used by an application level protocol SSRP on top of which the browser service runs. It helps when connecting to non-hidden instances named instances. In such cases TCP port is dynamic (unless specified) & determined when the Database Engine starts. It’s not needed if all connections contain the port#. When uninstalling SQL 9.0 from a machine running SQL 8.0 check the existence of registry key IsListenerActive, because if it exists SSRP will fail to listen. Denali Browser does not support sending information about SQL 8.0 instances. Refer à http://msdn.microsoft.com/en-us/library/cc219750(v=PROT.10).aspx |
DTS / SSIS |
3882 |
Be cautious a malformed request to port 3882/tcp can cause DOS. When communicating with remote SSIS port 135 is used & if it’s a SSIS package is running against a database server you need 1433 or as specified. Uses msdts1 protocol for service type msdts1. |
|
SSAS |
TCP |
2393, 2394, 2725 |
OLAP Services 7.0 used TCP ports 2393 & 2394. Though Ms has reserved UDP ports 2393 & 2394 those are not used by OLAP Services. Analysis Services uses TCP port 2725. For backward compatibility, Analysis Services uses TCP ports 2393 & 2394 when connected with an OLAP Services 7.0 client. |
SSAS |
TCP |
2383 |
Standard port for the default instance of Analysis Services. User configurable; |
Browser SSAS |
TCP |
2382 |
Client connection requests for a named instance of Analysis Services that do not specify a port number are directed to SQL Server Browser. |
RDP |
TCP |
3389 |
Providing the remote desktop to a client or VDI keep your eyes open because the default encryption certificate (RSA pk stored in mstlsapi.dll), is there with widows base install. A Man-in-the-Middle (MITM) attack can intercept the exchange of RDP encryption information. Check here for safety ribbons secure RDP using Transport Layer Security http://technet.microsoft.com/en-us/library/cc782610%28WS.10%29.aspx For 6.0 Network Level Authentication offers much stronger protection http://blogs.technet.com/askperf/archive/2008/02/16/ws2008-network-level-authentication-and-encryption.aspx |
Dynamic Port Range |
To comply with Internet Assigned Numbers Authority recommendations, Ms has increased the dynamic client port range for outgoing connections. Since the release of Win 6.0 new default port range is 49152 – 65535 which was earlier 1025 through 5000. |
||
Service Broker |
|
|
User configurable; there is no default port. BOL conventional configuration uses TCP 4022. |
SSL |
TCP |
443 |
When used with HTTP forming HTTPS, it provides an encrypted communication channel. |
HTTP endpoint |
|
|
Used when connecting through a url, this is user configurable; this can be customized while creating an endpoint. Port 80 for CLEAR_PORT traffic & 443 for SSL_PORT traffic. |
HTTPS endpoint |
TCP |
443 |
Default instance running over an HTTPS endpoint, used for a connection through url which used SSL. |
iSCSI |
3260, 860 |
|
|
SQL Agent File Copy |
135 |
Agent to copy backup files to the shared folder on the standby server.
|
|
137, 138, 139, 445 |
File copy on UNC shares. |
||
SQL Debugger |
TCP |
135 |
Exception for IPsec traffic might also require you to set an inbound rule for 500 & 4500 if IPsec is used for network communication. After opening port 135 include the applications Visual Studio à Devenv.exe / Management Studio à ssms.exe. |
Database Mirroring |
|
|
User configurable; there is no default port. While setting multiple instances be cautious to not to break the quorum. BOL conventional configuration uses TCP 7022. |
Replication |
TCP |
1433 |
For push transactional replication a working 1433 between distributor & subscriber is all you need, however in pull subscriptions few other ports are needed; when you launch an initialization of a subscriber SQL uses the windows default port 445 for mapped drives to copy down scripts. FTP (21) can be used initially to transfer schema & data over the internet; it can also use HTTP (80) or File & Print Sharing (ports 137,138, 139). You can put merge replication to use WEB synchronization using port 80 or encrypted 443. Replication uses the IIS endpoint, when syncing over HTTP (80 by default but configurable), however IIS process connects to SQL Server through standard ports. Keep in mind when synchronizing over the Web using FTP, there is no transfer between subscriber & IIS, it’s all amid IIS & the publisher. |
Cluster Service |
UDP |
3343 |
Cluster services control & manage the cluster database. Like the Heartbeat process - Cluster network driver (Clusnet.sys) performs intra-node communication between each node of the cluster by periodically exchanging sequenced, unicast/multicast UDP datagrams in the cluster. This determines whether all nodes are running correctly & network links are healthy. Generally this does not happens over the public network. There are cases when the range of random available IP ports that the cluster service uses to initiate communication through RPCs is less than 100 ports & connection to the Cluster Admin fails (refer to 154596(http://support.microsoft.com/kb/154596/ ) ). RPC – 135 / Cluster Network Drv – 3343 / SMB – 445 / NetBIOS – 139 / RPC 5000-5099 / 8011-8031
|
Cluster Admin |
UDP |
137 |
|
Random Ports |
UDP |
Check dynamic port range |
|
RPC |
TCP |
135 |
|
Filestream |
|
|
139 & 445. |
SSIS |
TCP |
135 |
DCOM |
WMI |
TCP |
135 |
Used by SSCM, it runs over DCOM (aka Network OLE) when accessing remote data. After initial connection DCOM randomly assigns a port for further communication where some tools may require a TCP port > 1024 (aka TCP high port) opened on the remote host. |
IPsec traffic |
UDP |
500 & 4500 |
Should be set to allow ISAKMP traffic to be forwarded for both inbound & outbound filters. |
MsDTC |
|
RPC |
Since NT 4, MSDTC has been performing as the transaction coordinator for components with COM & .NET architectures. Connected resources can be databases, message queues or file systems which may be distributed. Messages are sent on TCP 135 while the responses are on a dynamically assigned port. |
Source: http://www.sqlservercentral.com/articles/networking/75481/
vrijdag 9 december 2011
BizTalk Server 2010 R2 announced
- Platform Support – Supporting new and current server and development platforms
- Improved B2B – Aligning with industry standards and continuing to invest in performance improvements
- Ready for the Cloud – Enabling customers to take advantage of the benefits of cloud computing
BizTalk Server 2010 R2 will be delivered approximately 6 months following the release of Windows Server 8. Release timing for Windows Server 8 is yet to be announced.
More info: BizTalk Server 2010 R2 - BizTalk Server Team Blog
donderdag 8 december 2011
7 Preventable Backup Errors
the 7 errors he describes are:
- File Backups:
.MDF and .LDF files have been backed up - Drive Space:
the error message “Insufficient disk space for backup” or some similar message occurs - Transaction Log is Full:
alert that a transaction cannot complete because there is insufficient space in the log - Backing Up Across the Network:
backups are running so slowly that sometimes you get timeout errors and the logs fail - Only Have Differential Backups Available:
error: The log or differential backup cannot be restored because no files are ready to roll forward - Breaking the Backup Chain:
error: This differential backup cannot be restored because the database has not been restored to the correct earlier state - Restoring to the Wrong Server:
this isn’t a backup issue per se, but it is an extremely common event
Original blog post: 7 Preventable Backup Errors
vrijdag 25 november 2011
Perfomance monitor for BizTalk administrators
Blog: Perfomance monitor for BizTalk administrators - BizTalk Administrator Blog
dinsdag 22 november 2011
Cumulative update package 4 for BizTalk Server 2009
Content:
- BizTalk Server EDI support: FIX: A TA1 interchange acknowledgement is not returned when you use a two-way receive port to receive EDI interchanges in BizTalk Server
- BizTalk Server Design Tools: FIX: Visual Studio crashes when you build a project in BizTalk Server 2009 if message types are classes from a referenced .NET project
- Microsoft BizTalk Server Adapters: FIX: "Error encountered while querying virtual server state for URL" error when you configure WSS adapter in BizTalk Server 2009
!! Important Note:
After you apply this cumulative update, the settings for the DTA Purge and Archive Job roll back to default. This may cause backlog in the BizTalk Tracking (BizTalkDTADb) database. It is recommended to re-configure the job. For more information, visit the following Microsoft Web site: How to Configure the DTA Purge and Archive Job
Error 0xC0002A1F in BizTalk installation
Turned out this error code meant the following:
Error Code: 0xC0002A1F, Cannot perform encryption or decryption because the secret is not available from the master secret server. See the event log for related errors.
This of course was much clearer. It was clear I needed to restore the Master Secret needed of the SSO (Single Sign-on).
After restoring the master secret, all worked well.
maandag 21 november 2011
Error when configuring the BizTalk runtime
The Microsoft Distributed Transaction Coordinator (MSDTC) may not be configured correctly. Ensure that the MSDTC service is running and DTC network access is allowed on the BizTalk, SQL and SSO Master servers. For more information, see "MSDTC Configuration settings required for BizTalk Server" in the BizTalk Server Help.
To solve this issue, I did the following:
Go to Component Services (Click Start, click Run, and type dcomcnfg to launch the Component Services Management console).
Next, Click to expand My Computer, click to expand Distributed Transaction Coordinator, right-click Local DTC, and click Properties, as shown below.
Now Click the Security tab of the Local DTC Properties dialog.
If either the Mutual Authentication Required or the Incoming Caller Authentication Required configuration options are enabled then the client(s) computer account must be granted the Access this computer from the network user right. If the computer account for a client computer is not granted the Access this computer from the network user right, or is included in the Deny access to this computer from the network user right, then DTC communication between the client and server computer will fail.
These changes caused to give me following error:
New transaction cannot enlist in the specified transaction coordinator
The solution for this is to change the setting under Transaction Manager Communication to “No Authentication Required".
So the MSDTC Security configuration now looks like this:
woensdag 9 november 2011
Cumulatieve updatepakket 2 for BizTalk Server 2010
This cumulative update package for Microsoft BizTalk Server 2010 contains hotfixes for the BizTalk Server 2010 issues that were resolved after the release of BizTalk Server 2010.
More info: Cumulatieve updatepakket 2 for BizTalk Server 2010
Some neat tools for Biztalk / .NET developers
soapUI
soapUI is a free and open source cross-platform Functional Testing solution, a tool for SOA testing.
soapUI allows you to easily and rapidly create and execute automated functional, regression, compliance, and load tests. In a single test environment, soapUI provides complete test coverage and supports all the standard protocols and technologies.
http://www.eviware.com/soapUI/soapui-products-overview.html
linqpad
LINQPad lets you interactively query databases in a modern query language: LINQ.
LINQPad supports everything in C# 4.0 and Framework 4.0:
- LINQ to Objects
- LINQ to SQL and Entity Framework
- LINQ to XML
- Parallel LINQ
http://www.linqpad.net/
testdriven.net
TestDriven.Net makes it easy to run unit tests with a single click, anywhere in your Visual Studio solutions. It supports all versions of Microsoft Visual Studio and it integrates with the best .NET development tools.
http://www.testdriven.net/
ssmstoolspack
SSMS Tools Pack is an add-in for Microsoft SQL Server Management Studio. It contains a few upgrades to the SSMS IDE
http://www.ssmstoolspack.com/
deployment framework for biztalk
The Deployment Framework for BizTalk eliminates the pain associated with BizTalk application deployments, and goes far beyond BizTalk’s out-of-the-box deployment functionality. It also includes additional tools to enhance developer productivity, such as binding file management.
http://biztalkdeployment.codeplex.com/
biztalkcop
A set of FxCop rules for enforcing coding standards on BizTalk projects. First release includes configurable naming rules based on Scott Colestock's published conventions.
http://biztalkcop.codeplex.com/
smsniff
SmartSniff is a network monitoring utility that allows you to capture TCP/IP packets that pass through your network adapter, and view the captured data as sequence of conversations between clients and servers.
http://www.nirsoft.net/utils/smsniff.html
bizunit
BizUnit is a flexible and extensible declarative test framework targeted that rapidly enables the automated testing of distributed systems, for example it is widely used to test BizTalk solutions. BizUnit is fully extensible. Its approach is to enable test cases to be constructed from generic reusable test steps, test cases are defined in XML which allows them to be auto-generated and also enables the ‘fixing up’ of Url’s for different environments, e.g. test, staging and production environments. Defining test cases in XML enables test cases to be auto-generated.
http://bizunit.codeplex.com/
resharper
ReSharper is a renowned productivity tool that makes Microsoft Visual Studio a much better IDE.
http://www.jetbrains.com/resharper/
dansharp xmlviewer
DanSharp XmlViewer is a lightweight XPath generation and testing tool, making it easy to generate and test XPath queries. It also allows for validation of Xml documents against schemas, display of Xml documents in tree-view format, and generation of BizUnit test cases.
http://dansharpxmlviewer.codeplex.com/
bts terminator
A tool which allows for common biztalk problems to be addressed by scripts provided by the biztalk team. Replaces terminate.vbs with more functionality including the ability to suspend, resume and terminate by date range. Powershell script functionality provided for performance tuning. Integration with mbvcleanupscripts.xml from the messagebox viewer utility
http://www.microsoft.com/download/en/details.aspx?id=2846
Guideline on biztalkadminsblogging.com
debugview
DebugView is an application that lets you monitor debug output on your local system, or any computer on the network that you can reach via TCP/IP. It is capable of displaying both kernel-mode and Win32 debug output.
http://technet.microsoft.com/en-us/sysinternals/bb896647
msbuild explorer extension
The MSBuild Extension Pack provides a collection of over 400 MSBuild Tasks, MSBuild Loggers and MSBuild TaskFactories.
http://msbuildextensionpack.codeplex.com/
ilspy
ILSpy is the open-source .NET assembly browser and decompiler.
http://wiki.sharpdevelop.net/ILSpy.ashx
biztalk map documenter
The BizTalk Map Documenter stylesheet will transform a a BizTalk map into an HTML view containing the following information:
- The node links between source and destination schemas.
- All functoids used in the map are displayed with their parameters.
- Chained functoids are displayed as nested “function” calls.
- Labels
- Constants
- For HL7 schemas where source and desitnation are the same message type, links between different nodes are highlighted.
http://biztalkmapdoc.codeplex.com/
msxsl.exe
The msxsl.exe command line utility enables you to perform command line Extensible Stylesheet Language (XSL) transformations using the Microsoft XSL processor.
http://www.microsoft.com/download/en/details.aspx?displaylang=en&id=21714
Microsoft BizTalk LoadGen 2007
Microsoft LoadGen 2007 generates message transmission loads to run performance and stress tests for your Microsoft BizTalk Server applications, and provides performance counters to monitor the performance of the infrastructure running BizTalk Server.
http://www.microsoft.com/download/en/details.aspx?displaylang=en&id=14925
BizTalk Server Best Practices Analyzer
he BizTalk Server Best Practices Analyzer V1.2 examines a BizTalk Server 2006, BizTalk Server 2006 R2, or BizTalk Server 2010 deployment and generates a list of issues pertaining to best practices standards for BizTalk Server deployments.
http://www.microsoft.com/download/en/details.aspx?displaylang=en&id=15963
Performance Analysis of Logs (PAL)
The PAL (Performance Analysis of Logs) tool is a new and powerful tool that reads in a performance monitor counter log (any known format) and analyzes it using complex, but known thresholds (provided). The tool generates an HTML based report which graphically charts important performance counters and throws alerts when thresholds are exceeded.
http://pal.codeplex.com/
Log Parser 2.2
Log parser is a powerful, versatile tool that provides universal query access to text-based data such as log files, XML files and CSV files, as well as key data sources on the Windows® operating system such as the Event Log, the Registry, the file system, and Active Directory.
http://www.microsoft.com/download/en/details.aspx?displaylang=en&id=24659
Process Explorer
The unique capabilities of Process Explorer make it useful for tracking down DLL-version problems or handle leaks, and provide insight into the way Windows and applications work.
http://technet.microsoft.com/en-us/sysinternals/bb896653.aspx
Message Box Viewer
The goal of MBV is to retrieve the maximum amount of information from a BizTalk System in one click in the minimum amount of time, identify all possible issues which could be critical or need attention and present them in a user friendly format.
More info: http://blogs.technet.com/b/jpierauc/archive/2008/07/22/msgboxviewer-mbv-q-a.aspx%22
http://blogs.technet.com/b/jpierauc/archive/2007/12/18/msgboxviewer.aspx
TCP Trace
Used to monitor text based network traffic between client and server. Useful while using adapters like SOAP,HTTP,POP3 etc to see the message travelling via the wire.
http://www.pocketsoap.com/tcptrace/
DTCPing
This tool is designed to assist with troubleshooting Microsoft DTC Firewall Issues, which you'll often see in a multiserver BizTalk deployment.
http://www.microsoft.com/download/en/details.aspx?displaylang=en&id=2868
BizTalk Message Decompressor
This tool enables you to decompress BizTalk messages/context from a screen that looks like SQL Query Analyzer.
http://btsdecompress.codeplex.com/
maandag 7 november 2011
Using DocumentSpecName of the pipeline configuration
When no schema is defined and there are multiple schema's with the same combination for 'Target Namespace' (optional) and 'Root Name', you 'll get following error in the receive pipeline:
There was a failure executing the receive pipeline: "<ReceivePipeline>" Source: "XML disassembler" Receive Port: "<ReceivePortName>" URI: "<URI>\*.xml" Reason: Cannot locate document specification because multiple schemas matched the message type "<TargetNameSpace><RootName>".
The use of "DocumentSpecName" attribute in the configuration section of the pipelines is there to direct the pipeline to validate the message against a specific schema in the given assembly. The attibute should be filled with the schema full name ('<schema type>, <schema assembly>') as shown in below figure. This should solve the above error.
The issue becomes more complex when using multi-part schemas. In htis situation you'll get following error:
There was a failure executing the receive pipeline: "<ReceivePipeline>" Source: "XML disassembler" Receive Port: "<ReceivePort>" URI: "<URI>\*.xml" Reason: No Disassemble stage components can recognize the data .
What BizTalk want to tell us is that at this stage, given the specific configuration of DocumentSpecName Attribute, in the well known syntax of "<schema type> ,<schema assembly full name>" is not enough for multipart schemas.
Turns out that there should be an additional value is needed in the DocumentSpecName-attribute to fully define the schema. So the above value syntax is not enough, it will direct the pipeline to the desired schema in the assembly, but it doesn't say which root it should validate against.
The correct syntax in this case is : "<schema type>+<root name> ,<schema assembly full name>"
So by adding the root name after the '+' -sign solves the issue for multipart-schemas (schemas with multiple root nodes).
woensdag 19 oktober 2011
Biztalk File name Macros
It is however possible to use a bunch of other parameters in a filename. Here 's a list of possible macros to use in the filename:
%datetime%
Coordinated Universal Time (UTC) date time in the format YYYY-MM-DDThhmmss (for example, 1997-07-12T103508).
%datetime_bts2000%
UTC date time in the format YYYYMMDDhhmmsss, where sss means seconds and milliseconds (for example, 199707121035234 means 1997/07/12, 10:35:23 and 400 milliseconds).
%datetime.tz%
Local date time plus time zone from GMT in the format YYYY-MM-DDThhmmssTZD, (for example, 1997-07-12T103508+800).
%DestinationParty%
Name of the destination party. The value comes from message the context property BTS.DestinationParty.
%DestinationPartyID%
Identifier of the destination party (GUID). The value comes from the message context property BTS.DestinationPartyID.
%DestinationPartyQualifier%
Qualifier of the destination party. The value comes from the message context property BTS.DestinationPartyQualifier.
%MessageID%
Globally unique identifier (GUID) of the message in BizTalk Server. The value comes directly from the message context property BTS.MessageID.
%SourceFileName%
Name of the file from where the File adapter read the message. The file name includes extension and excludes the file path, for example, foo.xml. When substituting this property, the File adapter extracts the file name from the absolute file path stored in the FILE.ReceivedFileName context property. If the context property does not have a value, for example, if message was received on an adapter other than File adapter, then the macro will not be substituted and will remain in the file name as is (for example, C:\Drop\%SourceFileName%).
%SourceParty%
Name of the source party from which the File adapter received the message.
%SourcePartyID%
Identifier of the source party (GUID). The value comes from the message context property BTS.SourcePartyID.
%SourcePartyQualifier%
Qualifier of the source party from which the File adapter received the message.
%time%
UTC time in the format hhmmss.
%time.tz%
Local time plus time zone from GMT in the format hhmmssTZD (for example, 124525+530).
donderdag 13 oktober 2011
AlwaysOn - New in SQL Server 2012
SQL Server AlwaysOn is the new high availability and disaster recovery solution for SQL Server 2012. Using AlwaysOn businesses can achieve increased application availability for their mission critical applications and get higher returns on their high availability investments through better utilization of hardware resources. AlwaysOn also increases productivity and lowers TCO by greatly simplifying high availability deployment and management.
More Info: AlwaysOn - New in SQL Server Code Name "Denali" CTP3
SQL Server 2012
Microsoft has confirmed this release at the PASS Summit on October 12th.
Although Microsoft was yet to announce a specific availability deadline for SQL Server 2012.
Source: SQL Server 2012 Launches in H1 2012, Now in the Final Production Stages
Microsoft already released a Developer Training kit for SQL Server 2012.
This training kit is designed to help you learn how to develop SQL Server 2012 database and BI solutions.
SQL 2012 Training Kit: SQL Server 2012 Developer Training Kit
dinsdag 27 september 2011
BTS Project build error on string message
woensdag 14 september 2011
BUILD conference keynote summary
BUILD conference: impressions of Windows 8 keynote news - ctodx
donderdag 8 september 2011
SQL Recovery Models explained
To continue, I first need to explain the differences of logging levels
Logging Levels
Minimally logging
Minimal logging indicates it only logs the information that is required to recover the transaction without supporting point-in-time recovery. An operation is said to be minimally-logged if all it logs are the allocation changes. That means that there is not sufficient information in the log to replay the transaction.
So for example when doing a bulk insert only the allocations will be logged, not the inserted rows or the data on the pages. So this transaction can't be reproduced just by the information that was logged. SQL would be able to reallocate the pages, but it can't put the correct data in these pages.
A complete list of operations that will be minimally logged can be found here.
Fully logging
An operation is said to be fully logged if all information needed to reproduce the operation can be found in the logged information. This doesn't mean that for each operation every row will be individually logged in the transaction log. When doing a truncate on a table for example, it will only log the page de-allocations. But since this information is enough to reproduce the operation, it is still classified as fully logged.
In conclusion
Minimal logging is more efficient than full logging, and it reduces the possibility of a large-scale bulk operation filling the available transaction log space during a bulk transaction. However, if the database is damaged or lost when minimal logging is in effect, you cannot recover the database to the point of failure.
Recovery Models
Simple Recovery Model
The simple recovery model minimizes administrative overhead for the transaction log, because the transaction log is not backed up. The simple recovery model risks significant work-loss exposure if the database is damaged. Data is recoverable only to the most recent backup of the lost data. Therefore, under the simple recovery model, the backup intervals should be short enough to prevent the loss of significant amounts of data. However, the intervals should be long enough to keep the backup overhead from affecting production work. Including differential backups in the backup strategy can help reduce the overhead.
Generally, for a user database, the simple recovery model is useful for test and development databases or for databases containing mostly read-only data, such as a data warehouse. The simple recovery model is inappropriate for production systems where loss of recent changes is unacceptable. In such cases, we recommend using the full recovery model.
More information: Backup Under the Simple Recovery Model
Full Recovery Model
Provides the normal database maintenance model for databases where durability of transactions is necessary.
Log backups are required. This model fully logs all transactions and retains the transaction log records until after they are backed up. The full recovery model allows a database to be recovered to the point of failure, assuming that the tail of the log can be backed up after the failure. The full recovery model also supports restoring individual data pages.
More information: Backup Under the Full Recovery Model
Bulk-Logged Recovery Model
This recovery model bulk logs most bulk operations. It is intended solely as an adjunct to the full recovery model. For certain large-scale bulk operations such as bulk import or index creation, switching temporarily to the bulk-logged recovery model increases performance and reduces log space consumption. Log backups are still required. Like the full recovery model, the bulk-logged recovery model retains transaction log records until after they are backed up. The tradeoffs are bigger log backups and increased work-loss exposure because the bulk-logged recovery model does not support point-in-time recovery.
For a database that uses full recovery, switching to the bulk-logged recovery model temporarily for bulk operations improves performance. However, if data loss is unacceptable, to prevent data loss, it isrecommended that you switch to the bulk-logged recovery model only under the following conditions:
- Users are currently not allowed in the database.
- No modifications are made during bulk processing that are not recoverable without depending on taking a log backup; for example, by re-running the bulk processes.
- Before switching to the bulk-logged recovery model, you back up the log.This is important because, under the bulk-logged recovery model, if the database fails, backing up the log for bulk operations requires access to the data.
- After performing the bulk operations, you immediately switch back to full recovery mode.
- After switching back from the bulk-logged recovery model to the full recovery model, you back up the log again.
More information: Backup Under the Bulk-Logged Recovery Model
Summary of recovery models
Recovery model | Description | Work loss exposure | Recover to point in time? |
---|---|---|---|
Simple | No log backups. Automatically reclaims log space to keep space requirements small, essentially eliminating the need to manage the transaction log space. | Changes since the most recent backup are unprotected. In the event of a disaster, those changes must be redone. | Can recover only to the end of a backup. |
Full | Requires log backups. No work is lost due to a lost or damaged data file. Can recover to an arbitrary point in time (for example, prior to application or user error). | Normally none. If the tail of the log is damaged, changes since the most recent log backup must be redone. For more information, see Tail-Log Backups. | Can recover to a specific point in time, assuming that your backups are complete up to that point in time. For more information, see Restoring a Database to a Point Within a Backup. |
Bulk logged | Requires log backups. An adjunct of the full recovery model that permits high-performance bulk copy operations. Reduces log space usage by using minimal logging for most bulk operations. For more information, see Operations That Can Be Minimally Logged. | If the log is damaged or bulk-logged operations occurred since the most recent log backup, changes since that last backup must be redone. Otherwise, no work is lost. | Can recover to the end of any backup. Point-in-time recovery is not supported. |
maandag 29 augustus 2011
SQL Server educational links
There are multiple links on each of these subjects:
- Identifying SQL Server Bottlenecks and Performance Issues
- Moving Data in SQL Server
- Know your SQL Server Objects and Manipulate them
Source: Every .NET Developer Should Know About the Database they are working with
donderdag 25 augustus 2011
Visual Studio: VS templates missing
The error I got from Visual Studio was:
"Could not find file 'c:\Program Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\ItemTemplatesCahce\Web\Csharp\1033\WebForm.zip\WebForm_cb.aspx'."
This was the solution:
- Open "Visual Studio 2008 Command Prompt"
- Run the command: "devenv /installvstemplates"
dinsdag 23 augustus 2011
Biztalk Error: The system cannot find the file specified (Exception from HRESULT: 0x80070002)
So the full error in the event viewer looked like this:
A message received by adapter "FILE" on receive location "RECEIVE ORDERS PCE FILE" with URI "C:\B2B.TRADCOM.COM\ORDERS\INBOUND\PCE\*.xml" is suspended.
Error details: The system cannot find the file specified. (Exception from HRESULT: 0x80070002)
MessageId: {F83F1E4B-3B09-4F9B-A9D5-F6C1BD5C2698}
InstanceID: {E162E5AB-E621-4EA1-B643-FD843D7F8D44}
I was able to map the message using Visual Studio, so I was quite sure my BizTalk mapping was correct.
Now it turned out that I forgot to sign the assembly. So the system was unable to place the assembly in the GAC. Because I used a deploy script I didn't notice the resulting warning.
woensdag 17 augustus 2011
The Mystery of Query Timeouts by Kendra Little - YouTube
When your users keep hitting timeouts in their application, they naturally think the database is killing off helpless queries. In this webinar Kendra Little will tell you how to triage treacherous timeout situations and collect hard evidence about whether or not the problem is in the database. Do the right detective work and you can turn your frustrated users and irate developers into raving fans.
This session is be 200-level - you should have familiarity with OLTP concepts and understand what DMVs and Profiler are, but you don't have to be an expert with them.
SQL – Interview Questions and Answers
The series of blogs provides a simple way to go back over the building blocks of SQL Server. It's way to remind yourself of what you already know.
A Question and Answer discussion can also be a way to go over old topics in a more interesting manner. Especially if you have been working in the industry, or taking lots of classes on the topic, everything you read can sound like a repeat of what you already know. Going over a topic in a new format can make the material seem fresh and interesting. And an interested mind will be more engaged and remember more in the end.
The list of interview Questions and Answers is helpfull as a refresher for SQL developers/administrators or as a way to learn about SQL (as a beginner or to learn new things).
here's an overview of the complete Questions and Answers Series blogs
dinsdag 9 augustus 2011
BizTalk Server 2009 CU package 3 available
included hotfixes:
- BizTalk Server EDI support
- The EDI batching orchestration does not release batches on time in BizTalk Server 2006 R2 and in BizTalk Server 2009
- AS2 messages remain active after they are processed when the "Track Message Bodies - Request message after port processing" option is enabled on a send port in a BizTalk Server 2009 environment
- BizTalk Server Administration Tools & Configuration Tools
- "The group BizTalk Isolated Host Users doesn't exist" error message is logged when you configure the Exception Web Services by using the ESB Configuration Tool in a BizTalk Server 2009 environment
- All the tracking options under "Track Events" are selected unexpectedly after a BizTalk orchestration is created or updated in BizTalk Server 2009
- Applications stop responding or crash when System Center Operations Manager monitors BizTalk Server 2009 applications
- BizTalk Server Message Box and Message Agent, Pipelines & Tracking
- Performance decreases when a server that is running BizTalk Server 2009 processes a large batch of messages after you customize the settings of the "Large Message Threshold" option and of the "Large Message Fragment size" option
- Error message when you receive a MIME or SMIME document in BizTalk Server: "Item has already been added"
- BizTalk Server XLANG engine
- White space is removed if a message is processed by a mapping operation that is included in a Construct Message shape in BizTalk Server
- BizTalk Server Setup
- Cumulative update package 2 for BizTalk Server 2009 fails if a BizTalk group uses a database that uses a case-sensitive collation
Prerequisites
To apply this update, you must have BizTalk Server 2009 installed. For detailed information about how to install this update, see the Readme.txt file that is included in the update package.
Notes
- You have to stop the following services before you apply this update:
- ENTSSO
- IISADMIN
- WINMGMT
- BTSNTSVC
- To install this update in a BizTalk group that includes multiple BizTalk servers, install this server update on each server individually instead of concurrently.
Source: http://support.microsoft.com/kb/2557149
BizTalk Webcast
LINK: http://www.cloudcasts.net/Default.aspx?category=BizTalk
vrijdag 29 juli 2011
Improving BizTalk Server throughput and identifying bottlenecks
Source: Improving BizTalk Server throughput and identifying bottlenecks « Integration Experts – Dipesh Avlani
dinsdag 26 juli 2011
BizTalk Training Resources
First of all here's an interesting post that explains the way Biztalk works by Steef-Jan Wiggers.
A more detailed picture of the BizTalk architecture:
Or if you're interested in some more detailed Biztalk architecture posters:
http://www.biztalk247.com/posters.aspx
Here's another great reference, here you can find a list of tutorial video's, books, virtual labs, and more: http://sandroaspbiztalkblog.wordpress.com/2011/07/13/biztalk-training-resources-virtual-labs-tutorials-virtual-machine-and-more/
vrijdag 15 juli 2011
The future of BizTalk
Today I found some Blogs which summarizes the presentation given by Microsoft’s Tony Meleg. It seems that BizTalk as product/brand name may go away after few years but the integration concepts are going to remain. As I understood, no new features would be released anymore, only some maintenance releases.
Presentation video: AP03 - The Future of Middleware and the BizTalk Roadmap
Presentation slides: Download Session Presentation
Summarizing blogs:
donderdag 14 juli 2011
Released: Microsoft SQL Server 2008 R2 SP1 and SQL Server Denali CTP3
Also PowerPivot for Microsoft Excel 2010 was updated as a separate download.
Source: Released: Microsoft SQL Server 2008 R2 Service Pack 1 - Analysis Services and PowerPivot Team Blog - Site Home - MSDN Blogs
Dependency service or group failed to start
My SQL service is running on my domain user account, and this is the reason I got the error. To be able to run any services using a domain account, the Netlogon service must be started.
For some reason (I blame the windows updates that were installed) this services startup type was changed to Disabled. Reconfiguring the Netlogon service to automatic and start the service solved the problem.
info
Netlogon: Maintains a secure channel between this computer and the domain controller for authenticating users
Microsoft Lightswitch coming on July 26
Microsoft’s LightSwitch to Launch on July 26. This program will give developers a simpler and faster way to create high-quality business applications for the desktop and the cloud. LightSwitch is a new addition to the Visual Studio family.
I've already been playing with Lightswitch some time ago + I've seen the presentation on Techdays 2011 in Belgium. The new Visual Studio addition definitely has some promising features, and is easy to use. It could get quite handy for some (smaller) projects.
Lightswitch makes sure you'll get a working program fast with pre-configured screen templates, prewritten code and other reusable components to handle routine application tasks, along with helpful step-by-step guidance.
And afterwards you can of course customize it all in Visual Basic .NET or C#. To finalize, you can deploy to the desktop, browser, or cloud to share your application with others more easily without the cumbersome installation processes.
More info: Lightswitch, a developers tool, will launch on July 26
Videos and tutorials: http://www.microsoft.com/visualstudio/en-us/lightswitch
maandag 11 juli 2011
Free E-book: SQL Server Execution Plans
Which indexes are getting used and where no indexes are being used at all.
How the data is being retrieved, and joined, from the tables defined in your query.
How aggregations in GROUP BY queries are put together.
The anticipated load, and the estimated cost, that all these operations place upon the system.
All this information makes the execution plan a fairly important tool in the tool belt of database administrator, database developers, report writers, developers, and pretty much anyone who writes TSQL to access data in a SQL Server database.
Download link: http://downloads.sqlservercentral.com/Books/dissecting_complete.pdf?utm_source=ssc&utm_medium=weblink&utm_content=Grant&utm_campaign=sqltoolbelt
Source: SQL Server Execution Plans - SQLServerCentral
woensdag 29 juni 2011
ESB Toolkit 2.0
Source: BizTalk :: KOTI REDDY B: ESB Toolkit 2.0
donderdag 16 juni 2011
CU 1 voor de BizTalk-Adapter Pack 2010
It contains following hot fixes:
- FIX: The WCF-SQL adapter from BizTalk Adapter Pack 2.0 or from BizTalk Adapter Pack 2010 does not write enough useful error information
- FIX: A WCF-based SQL adapter may lock SQL Server resources when the PolledDataAvailableStatement binding property returns a positive result but the actual polling does not return any data
- FIX: Statement in the PollStatement property incorrectly runs if a receive location uses WCF-based BizTalk Adapter for SQL Server
- FIX: An update is available that adds the ClearRfcContext binding property to the WCF-based SAP adapter from BizTalk Adapter Pack 2.0 or BizTalk Adapter Pack 2010
- FIX: Multiple grouped IDOCs are processed incorrectly if the WCF-based SAP adapter in BizTalk Adapter Pack 2.0 or BizTalk Adapter Pack 2010 uses the String setting to connect to an SAP system
- Hotfix to add the "ReceivedIdocRelease" binding property for the WCF-SAP adapter to BizTalk Adapter Pack 2.0 and Microsoft BizTalk Adapter Pack 2010
BizTalk Server 2010 Developer Training Kit
This training kit contains a complete set of materials that will enable you to learn the core developer capabilities in BizTalk Server 2010. This kit includes lab manuals, PowerPoint presentations and videos, all designed to help you learn about BizTalk Server 2010. There is also an option below to download a Virtual Machine that is ready for you to use with the training kit.
After completing this course, students will be able to:
- Work with schemas, maps, and pipelines, and create flat file schemas.
- Configure a new FTP, HTTP and Windows SharePoint Services (WSS) adapter for BizTalk Server
- Use BizTalk Orchestration Designer to create and test a simple orchestration.
- Configure orchestration properties and variables, deploy an orchestration, and create and deploy a rule set and execute those rules from within an orchestration.
- Define, deploy, and map a BAM observation model.
- Use the deployment and management features in BizTalk Server
- Build a simple Windows Communication Foundation (WCF) service and client and configure BizTalk Server to use a WCF Adapter.
- Create a Microsoft .NET class library project that will contain a WCF Adapter.
- Deploy artifacts needed for processing certain EDI documents and for turning XML messages into EDI.
DOWNLOAD: http://www.microsoft.com/download/en/details.aspx?id=14865
dinsdag 7 juni 2011
VS2008: web services enumeration components not available
The web services enumeration components are not available. You need to reinstall Visual Studio to add web references to your application.
I have no idea why this error suddenly appeared.
However, I did find a solution to this issue.
I executed 'devenv /ResetSkipPkgs' from the command line in a VS2008 command prompt.
This did the trick for me.
vrijdag 27 mei 2011
SQL: Index Scan Vs. Index seek
An index seek is where SQL server uses the b-tree structure of the index to seek directly to matching records (see http://mattfleming.com/node/192 for an idea on how this works) - time taken is only proportional to the number of matching records.
In general an index seek is preferable to an index scan (when the number of matching records is proprtionally much lower than the total number of records), as the time taken to perform an index seek is constant regardless of the toal number of records in your table.
Note however that in certain situations an index scan can actually be faster than an index seek - usually when the table is very small, or when a large percentage of the records match the predicate.
woensdag 18 mei 2011
Microsoft SQL Server 2008 R2 Service Pack 1
What’s New in SQL Server 2008 R2 Service Pack 1
sys.dm_exec_query_stats DMV is extended with additional columns to improve supportabilities over troubleshooting long-running queries. New DMVs and XEvents on select performance counters are introduced to monitor OS configurations and resource conditions related to the SQL Server instance.
Syntax for FORCESEEK index hint has been modified to take optional parameters allowing it to control the access method on the index even further. Using old style syntax for FORCESEEK remains unmodified and works as before. In addition to that, a new query hint, FORCESCAN has been added. It complements the FORCESEEK hint allowing specifying ‘scan’ as the access method to the index. No changes to applications are necessary if you do not plan to use this new functionality.
The new Data-tier Application (DAC) Framework v1.1 and DAC upgrade wizard enable the new in-place upgrade service for database schema management. The new in-place upgrade service will upgrade the schema for an existing database in SQL Azure and the versions of SQL Server supported by DAC. A DAC is an entity that contains all of the database objects and instance objects used by an application. A DAC provides a single unit for authoring, deploying, and managing the data-tier objects. For more information, see Designing and Implementing Data-tier Applications.
This update introduces two new configuration settings that let you determine how long cached data stays in the system. In the new Disk Cache section on the PowerPivot configuration page, you can specify how long an inactive database remains in memory before it is unloaded. You can also limit how long a cached file is kept on disk before it is deleted.
Source:Download details: Microsoft® SQL Server® 2008 R2 Service Pack 1 Community Technology Preview
SQL Server 2008 Developer Training Kit
Microsoft has a training kit available to do this with slides, demos and hands-on labs.
DOWNLOAD: SQL Server 2008 Developer Training Kit
Since Januari 2011 there is also an update available.
New Content: Build Your First Microsoft BI Solution with SQL Server 2008 R2
This update includes a rich new set of content designed for developers who want to learn how to build their first Microsoft Business Intelligence solution with SQL Server 2008 R2. Microsoft BI solutions leverage your existing technology investments in .NET, SQL Server and Office to develop rich integrated reporting and analytics experiences that empower users to gain access to accurate, up-to-date information for better, more relevant decision making. This content is a complete training course that contains eleven units covering all the key aspects of Microsoft BI solution development. You can find it by navigating to the Getting Started - BI Developers page. Here is a summary of what’s included:
31 presentations (PowerPoint slides, videos and transcripts included)
27 demos (installer scripts, videos and transcripts included)
12 hands on labs (installer scripts included)
More Info + Download: SQL Server 2008 R2 Update for Developers Training Kit
dinsdag 10 mei 2011
interesting vids
Too bad though that some interesting sessions took place on the exact same moment. So I could only follow one of them.
Luckily however, they announced that all sessions would be recorded and placed on the channel 9 web site to view later.
Well, I'm still waiting for those sessions to appear on the website...
I've found some other Microsoft technology event sessions of this year that were on channel 9 already. So for now, I won't have any evenings not knowing what to do :).
woensdag 4 mei 2011
Promoted property vs distinguished field - tutorial
This is because of a holiday, a course on SQL 2008 and off course attending the techdays 2011 Belgium.
I recently found an interesting blog on the difference between promoted properties and distinguished fields in BizTalk. It explains the differences between them both and shows you how to add both of them to your schema.
BLOG: Francois Malgreve - Bangkok: Promoted property vs distinguished field - tutorial
donderdag 24 maart 2011
Cumulative update package 2 for BizTalk Server 2009
Cumulative update package 2 for BizTalk Server 2009