|
With this Utility
you can download and save interlinked pages automatically. Starting from one or several initial pages the links are followed and stored in the cache archive.
Start of Utility
Please, start the mirroring with the symbol 
in the main menu. You get the configuration dialog: Mirror
You also can alternatively start the mirroring with the script MM3-Utility in the folder MM3-WebAssistantProfessional/script/.
You can save a mirroring configuration in a Set. At first use the set default. With New you create
a new set. Furthermore you can Rename or Delete a set with a pop-up menu.
General
Start Page
Starting from one or several initial pages the links are followed, pages are downloaded and stored in the cache archive. Enter the URL for every start
page in a new line.
Note
There are restrictions at the link following of dynamic elements like Java Skript and Flash.
Surf Set
The parameters of the Surf Set are used with the exception of Marker and Prefetch. An important parameter is the re-use
time of files in the cache archive. Files aren't downloaded newly from the internet within their re-use time.
Depth
Please note that you need with higher depth a larger proportion of bandwidth and hard disk space. Often this is not foreseeable, how many HTML
pages are actually tracked and downloaded. Depending on application you should limit the links to be followed regarding to the depth. You can in addition
use a filter.
Report
You can create a report on the followed links. You can select between a report with all links or only with the links at which a file was downloaded.
Log
All links followed up are logged per default.
You are able to log the following URLs in addition:
| Log with | In a HTML page ... |
| Contained resources | all contained resources |
| Not followed links | all not followed links |
|---|
In the summary you can log links not followed in addition.
Note
Pages and resource occurring repeatedly are logged only once.
Following Links
If too many pages are downloaded at a mirroring, you can prevent this with a filter so. You can define in a filter: domain, directory, file name, file
or MIME types. With the additional parameter Follow the effect of the filter is controlled by the link following.
Meaning:
| Follow | Following or excluding link |
| Yes | Follow: If the link includes the character pattern of the filter. |
| No | Exclude: If the link includes the character pattern of the filter. |
| --- | Deactive: Filter isn't use. |
|---|
If both, Follow and Exclude, meet a link, then the link will be excluded and the page won't be downloaded.
The detailed structure of the filter is described: Filter for Following Links
Example:
| Follow | Domain | Path | File | Typ |
| Yes | *.Proxy-Offline-Browser.com | /*/ | * | * |
| No | *.Proxy-Offline-Browser.com | /*/ | * | pdf
application/pdf |
| No | *.Proxy-Offline-Browser.com | /private/*/ | * | * |
|---|
Only pages are downloaded from the domain Proxy-Offline-Browser.com, however no pdf documents and pages from the folder /private/ and its subdirectories.
Please select, whether the link has to be followed, excluded or enquired generally. With Enquire, you can indicated when mirroring
interactively whether is a link to follow or to exclude.
Log
Log all pages which were excluded from the link following. You hereby can check the setting of the filter.
Cookie
Cookies can be accepted or blocked depending on filter setting. This supports the protection of data privacy. You also can prevent the representation
of history (breadcrumb trail) on a HTML page with that, however.
Meaning:
| Accept | Cookie accept or block |
| Yes | Accept: If the URL includes the character pattern of the filter. |
| No | Block: If the URL includes the character pattern of the filter. |
| --- | Deactive: Filter isn't use. |
|---|
If both, Accept and Bock, meet a cookie, then the cookie will be blocked.
The detailed structure of the filter is described: Filter for Cookie
Example:
| Accept | Domain | Path |
| No | *.*.* | /*/ |
|---|
All Cookies are blocked.
Log
All accepted cookies are logged. You hereby can check the setting of the filter.
Authentification
For a password protected web site the user name and the password can be saved. You can in addition indicate whether the password shall be saved at
the call of a protected page.
Passwords can be protected with a master password. The master password has to be entered at every start of the Utility Mirror.
Note
Only log-ins can be processed if the log-in is requested over the http protocol header (registration with dialog box of the browser). Log-ins over a
HTML-form aren't supported.
Start of the mirror
After you have filled out the required configuration or selected a set then you start the mirroring. In a dialog the mirroring is logged. A summary
is displayed at the end of the mirroring or at the cancel. A report can be displayed in the browser.
Display of the reports
You reach the reports from the local sitemap (or direct by URL: http://127.0.0.1:8080/mirror/).
You select the desired report from a list. A report contains the followed links of a mirroring. You can adjust the display:
- Number of followed links per report page.
- Sorting sequence of the followed links.
- Representaion of the report page
You can surf in a report.
|