Semi-structured data often contains a mix of structured tables and unstructured text. It's a flexible data format that can combine organized data elements with more free-form content, making it suitable for a wide range of data types and use cases, such as web data and NoSQL databases.

In transfer learning, a model trained on a large dataset is used as a starting point, and the knowledge gained is transferred to a new, similar task. This leverages the pre-trained model's knowledge to improve performance on the new task, particularly when the tasks are related.

When working with large datasets that do not fit into memory, the Python library "Dask" is a useful tool for efficient computations. Dask provides parallel and distributed computing capabilities, enabling data scientists to handle larger-than-memory datasets using familiar Python tools.

Convolutional Layers in neural networks are responsible for feature extraction and learning spatial hierarchies, making them crucial in tasks such as image recognition. They apply filters to the input data, capturing different features.

In time-series analysis, creating lag features means using previous time steps (observations) as new data points. This allows you to incorporate historical information into your model, which can be valuable for forecasting future values in time series data.

Residual Networks (ResNets) are known for their residual connections, which allow for easier training of very deep networks. ResNets have become a standard in deep learning due to their ability to mitigate the vanishing gradient problem, enabling the training of much deeper architectures.

A Box Plot is a commonly used visualization for detecting outliers in a single variable. It displays the distribution of data and identifies potential outliers based on the interquartile range (IQR). Data points outside the whiskers of the box plot are often considered outliers. Box plots are useful for identifying data anomalies.

Data Preprocessing is the step in the Data Science Life Cycle that involves cleaning the data, handling missing values, and preparing it for analysis. This step is crucial for ensuring the quality and reliability of the data used in subsequent analysis.

In L2 regularization (Ridge), the penalty is proportional to the square of the magnitude of the coefficients. This regularization technique adds a penalty term to the loss function based on the sum of squared coefficients, which helps prevent overfitting by discouraging large coefficients.

Data formats like XML allow for tagging or marking up data, which gives it a structured organization. XML is an example of semi-structured data, where data elements are labeled, providing some level of organization.