arcanedev/robots

Robots.txt generator

Maintainers

πŸ‘ arcanedev

Package info

github.com/ARCANEDEV/Robots

pkg:composer/arcanedev/robots

Statistics

Installs: 614

Dependents: 1

Suggesters: 0

Stars: 7

Open Issues: 0

2.0.0 2015-10-23 18:17 UTC

Requires

Requires (Dev)

Suggests

None

Provides

None

Conflicts

None

Replaces

None

MIT 094d3e82d04e3368cbe7953d9f84fdca85239e93

robotslaravelarcanedev

This package is auto-updated.

Last update: 2026-06-05 22:46:52 UTC


README

πŸ‘ Travis Status
πŸ‘ HHVM Status
πŸ‘ Coverage Status
πŸ‘ Scrutinizer Code Quality
πŸ‘ SensioLabs Insight
πŸ‘ Github Issues

πŸ‘ Packagist
πŸ‘ Packagist Release
πŸ‘ Packagist Downloads

By ARCANEDEVΒ©

Features

  • Framework agnostic package.
  • Well documented & IDE Friendly.
  • Well tested with maximum code quality.
  • Laravel 4.2 supported.
  • Laravel 5 supported.
  • Made with ❀️ & β˜•.

Requirements

- PHP >= 5.5.9

INSTALLATION

Composer

You can install this package via Composer. Add this to your composer.json :

{
 "require": {
 "arcanedev/robots": "~2.0"
 }
}

Then install it via composer install or composer update.

Laravel

Setup

Once the package is installed, you can register the service provider in config/app.php in the providers array:

'providers' => [
 ...
 Arcanedev\Robots\RobotsServiceProvider::class,
],

And the facade in the aliases array:

'aliases' => [
 ...
 'Robots' => Arcanedev\Robots\Facades\Robots::class,
],

USAGE

Laravel

The quickest way to use Robots is to just setup a callback-style route for robots.txt in your app/routes.php file.

Route::get('robots.txt', function() {

 // If on the live server, serve a nice, welcoming robots.txt.
 if (App::environment() == 'production') {
 Robots::addUserAgent('*');
 Robots::addSitemap('sitemap.xml');
 }
 else {
 // If you're on any other server, tell everyone to go away.
 Robots::addDisallow('*');
 }

 return Response::make(Robots::generate(), 200, ['Content-Type' => 'text/plain']);
});

Hard Coded

Add a rule in your .htaccess for robots.txt that points to a new script (or something else) that generate the robots file.

The code would look something like:

require_once __DIR__ . '/../vendor/autoload.php';

use Arcanedev\Robots\Robots;

$robots = new Robots;

$robots->addUserAgent('Google');
$robots->addDisallow(['/admin/', '/login/', '/secret/']);
$robots->addSpacer();
$robots->addSitemap('sitemap.xml');

header('HTTP/1.1 200 OK');
echo $robots->generate();

TODOS

  • Documentation

DONE

  • Framework agnostic package.
  • Examples
  • Laravel v4.2 Support.
  • Laravel v5.0 Support.
  • Laravel v5.1 Support.

Contribution

Any ideas are welcome. Feel free to submit any issues or pull requests, please check the contribution guidelines.